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PREFACE 



This report stems from a concern about the effects of local television news in 
major metropolitan markets. Earlier Rand research had found that local television 
news viewing related to local knowledge differently in central cities than in the 
suburbs (W. A. Lucas and K. B. Fossner, Television News and Local Awareness: A 
Retrospective Loofc, R-1858-MF, October 1976). A theory of the effects of different 
media environments was subsequently developed, and seven cities in western Penn- 
sylvania were selected for study because they represented the media contexts of 
theoretical interest within the samfe state. Afler a review of the relevant literature, 
it was concluded that the telephone was on balance the preferred means of collect- 
ing data on citizen media use and p(^itical knowledge. Rand then submitted a 
proposal to the Political Science program of the National Science Foundation for 
funds to carry out the research. 

When NSF had the proposal reviewed, it found sharp division among profes- 
sionals in the survey research community..While the telephone has become widely 
used in marketing research, some social scientists in academic circles continue to 
doubt the validity of data collected by telephone. The ou^ome was that Rand was * 
funded 'to conduct the news media study, including u methodological study of the 
relative validity of personal and telephone surveys within the broader investiga- 
tion. 

This report docutnents the methodological study conducted for NSF. It serves 
two purposes. It establishes the reliability of the data collected in Rand's investiga- 
tion of the effects of local media in the seven western Pennsylvania cities, and 
records the methodology used in that investigation. At the same time, it contributes 
to a general understanding of the strengths and weaknesses of telephone surveys 
for studying political and communications behavior. 
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SUMMARY 



Criticism of telephone surveys has focused on biases that could result in the 
sample obtained by telephone and in answers elicited over the telephone. In the 
past, telephones were a biased way of securing general population. data because 
large numbers of disadvantaged families could not afford them. Recent research 
suggests, however, that by 1976 saturation was so high that the exclusion of non- 
telephone households was no longer a liability for telephone survey sa^mpling in 
most parts of the country* 

Available techniques of random-digit and added-digit dialing are shown to 
provide representative saniples of telephone households. The difficult trade-off in 
the design of telephone sampling procedures is the choice between complex systems 
that maximize the representativeness of within-household selections, and short 
systems of within-household respondent selection procedures that minimize refus- 
als. Data collected in western Pennsylvania are used to illustrate the impact of the 
joint effects of sampling telephone households, added-digit dialing, within- 
household selection procedures, refusal rates, und^ther factors which might affect 
the sampling power of telephone surveys. Estimates of population characteristics 
obtained by telephone and personal surveys, in seven western Pennsylvania cities ^ 
were compared to Census data, voting registration and turnouts, and other avail- 
able data. Telephone survey estimates for each city were acceptable representa- 
tions of the adult populations. When the results in the two cities where both 
telephone and personal surveys were conducted were compared, the personal sam- 
ple was somewhat less representative of the population\lue to its cluster structure. 

Most observers agree that accurate data can be collected by telephone when it 
does not involve questions the respondent considers sensitive. Concern has focused 
on respondent willingness to report sensitive information and bias due to social 
desirability. A review of the literature and data froni the the two Pennsylvania 
cities where comparative telephone and personal interviews were collected support 
the view that respondents are willing to provide detailed and personal information 
on a variety of personal topics over the telephone that is comparable to that 
obtained in person. In addition, telephone interviewing may lead to slight reduc- 
tions in socially desirable and presumably less distorted answers, although the 
effects are fairly subtle. 

Further comparative analysis of the personal and telephone interviews found 
a few differences which appeared to be associated with complexity ofAfi questions 
and the pcicing of interviews. The problems posed by complex que^ons, coupled 
with the faster pace of telephone interviews, may be more important issues for 
telephone surveys than subject matter sensitivity. 

Centralized telephone interviewing was found to offer many opportunities for 
improving quality control over the survey data. Quality qontrol, along with the 
sampling and response findings, means that telephone interviewing does not have 
to be justified by virtue of its substantially lower costs. For many purposes, it is 
competitive or superior to personal interviewing. 

Findings from the Pennsylvania surveys were consistent with a growing body 
of research which support the conclusion that telephone surveys can provide repre- 



sentative samples of the general population and can obtain reliable answers on 
sensitive as well as factual subjects. The telephone survsy does as well as the 
personal Survey for most purposes and has greater potential for quality and flexibil- 
ity at lower cost. 
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1. INTRODUCTION 

* 



D^pite the steady growth and widespread use of telephone surveys in commer- 
cial marketing, many academic researchers have continued to view that methodol- 
ogy with suspicion. The reasons for this reluctance are varied, but they can be 
broadly grouped into three categories. Bias in data collected by telephone could 
potentially result (1) from the use of telephone households rather than, all 
households as a sampling universe, [2) from bias in the selection of a sample of 
telephone households due to unlisted telephone numbers, (3) from refusals during 
the process of contacting and gaining respondents' cooperatipn, and ('^) froni'Jimita- 
tions on the questions that can be asked and the reliability of answers elicited dvcm- 
the telephone. If any of these sources of error contaminate the data, the results 
would not be an accurate representation of the characteristics of the population 
under examination. 

This section treats the first — ancj most telling — of these criticisms, the charge 
that telephone households are not representative of the population. As the data will 
show, this view has been correct but it is no longer true today. The second section 
will treat issues of telephone sampling procedures, refusal rates, and within- 
household selection procedures to show that proper telephone survey methods can 
provide an acceptable sample. The third section will treat the reliability of re- 
sponses given by telephone and through personal interviews to show what can, and 
what cannot, be asked by telephone. The conclusion will treat issues of cost and 
management of telephone surveys, and discuss the general value of the telephone 
survey for research. 



ARE TELEPHONE HOUSEHOLDS REPRESENTATIVE? 

Historically, telephone interviewing has been a very biased w. of securing 
general population data because large numbers of disadvantaged families could not 
afford telephone service. Even as recently as 1960, fe\.er than 75 percertt of all 
households had telephones and the distribution was highly correlated with econom- 
ic status. Fewer than half the families with income under $2,000 had telephones 
' compared to 96 percent among those earning between $15,000 and $25,000." During 
the 1960s and early 19708, however, the telephone came to be virtually ubiquitous. 
Recent research suggests that by 1976 saturation was so high that the exclusion of 
non-telephone households was no longer a liability for telephone survey sampling 
in most parts of the country. 

Prior to the 1970s, studies of the distribution of telephone households were 
usually pessimistic about the problems of telephone samples. Schmiedt^fikamp re- 
ported considerable differences in the characteristics of households with and with- 
out telephones.* Homes without telephones constituted 26 percent of the American 

' U.S. Census Bureau, Characteristics of Houst^holds with Telephones, March ('urrvnt Vofm- 

latum Hvports. Series P-20, No. 146, Decemher 1%5. 

^ Jav W. Schmeideskamp, "Reinterviews by Telephone," Jourtml of Marhrtni^, Vol. 2^. January 
m2. pp. 28.:<4. 
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population in the 1959 University of Michigan Survey Research Center sample. 
Table 1 shows the extent of major differences in the socioeconomic status of the two 
groups. Over half those without telephones had family incomes of under $3,000, 
while only 19 percent of those with telephones were in the low income bracket. 

r 

t 

• Table 1 

t 

1959 Characteristics of Telephone Owners and Non-Owners 



Respondent Characteristics 


Telephone 
Owners 


Telephone 
Non-Owners 


Family Income: 






l^ss than $3,000 


19% ' 


62% 


$3,000 -$4,999 


25 


31 


$5,000 -$7,490 


30 


.14 


$7,500 and over 


26 


3 


Education: 




52 


Grade school or less 


29 


At least some high school 


45 


40, 


At least some college 


. 26 

r 


8 , 



SOURCE: Schmiede8kamR {1962), p. 29," University of 
Michigan, Sufvey Research Center 1989 Survey. 



By 1965, growth in the number of telephones had reduced the disparity, though 
there were still important distinctions between the 31 percent of all houseltolds 
with telephones and the 19 percent without telephones. A Census Bureau study 
that year,=' which has never been updated, documented the differences shown in 
Table 2. Over 95 percent of those. with. incomes over $10,000 had telephones, while 
from one-half to three-fourths of those earning less than $5,000 had telephones. The 
median income- in the preceding year for primary families with telephone was ^ 
$7,281, while that of those without telephones was only $3,386. There was a compar- 
able disparity for primary individuals (those living alone or with non-relatives).* 
As a result, telephone' surveys as late as the mid-1960s were likely to have a 
serious sampling bias. For example, Kegeles, Fink, and Kirscht sought to reinter- 
view by telephone a known group of 744 people in 1964.* The group was composed 
of about half of the original respondents to an earlier national survey conducted 
through personal interviews. Those that could be reached for the reinterview by 
telephone (n- 542) overrepresented white, middle and upper income, urban and 
non-South, and highly educated individuals. The relative absence of the telephone 
in poor, blacK, and Southern homes was reflected in Sample bias. 

By 1970, the proportion of the population with telephones had come to reflect 
substantially the demography of the entire population. Using data from the 1970 

1 =* U. S. Census Bureau. 1965. op. cit, 

* Foi-flirtluT discussioas of tlio 196fj Census Bureau report .ht In^rid C. Kilde^aard. "Telephone 
Trend.s." .hurmil ofAdvertmnn Reseiirrh. Vol. 6. June I96«. pp. 56-6(); and Jost-ph B. Perr.v Jr.. ' A Note 
on the I'se ofTelephone Directories as a Sample Source." i'uh/ic Opinion Qiairtfrly, Vol.' 32. Winter 
I9H8-69. pp. 691-69. 

•■' S. .Stephen KeKfles, Clinton F. Fink and John P. Kirscht. "Interviewing a National Sample bv Ixmn 
I)i}(tanir Telephone." Puhlw Opwum Qi/firftr/v. Vol. ;3:3, Fall 1969. pp. 412-419. 



Table 2 • 

Percent of Households with Telephones by Income: 

1960 AND 1965 



Total Money Income* 






1960-1965 


of Primary Families 


1965 Percent 


^ 1960 Percent 


Change Percent 


and Individuals 


with Telephone 


with Telephone 


with Telephone 


Under $1,000 


55.7 


43.5 


+ 12.2 


$1,000 to $1,999 


61.5 


50.3 


+ 11.2 


$2,000 to $2,999 


^66.7 


57. Q 


+ 9.7 


$3,001 to $3,499 


'70.7 


66.1 


+ 4.1 


$3,500 to $8,999 


73.4 ■ 


65.9 


+ 7.5 


$4,000 to $4,499 


74.3 


72.8 


+ 1.5 


$4,500 to $4,999 


76.5 


76.8 


- 0.3 


$5,000 to $5,999 


80.7 


82.8 


- 2.1 


$6,000 to $6,999 


85.9 


86,4 


- 2.4 


$7,000 to $9,999 


92.7 


92.4 


+ 0.3 


$10,000 to $14,999 


95.6 


95.0 


\ + 0.6 


$15,000 to $24,999 


96.2 


96.0 


+ 0.2 


$25,000 and over 


95.4 


92.9 


+ 2.5 



SOURCE: Census Bureau (1965), p. 5. 



Census, Tuchfarber and Klecka tabulated^ and compared characteristics of 
households with a telephone avai lable to all households riationwide using data from 
the "1 in 10,000 Public Use Sample."* Thi 87 percent of all 1970 households with 
a telephone available was closely converging with ine demographic traits of all U.S. 
households (Table 3). 

Then by 1976, the share of the population with telephones came even closer to 
mirroring the entire national population in terms of household income, education, 
race and other demographic measures. The 1976 Law Enforcement Assistance 
Administration's National Crime Survey revealed that the socioeconomic differ- 
ences between telephone and non-telephone homes had all but disappeared. Based 
oh personal interviews in 10,043 households in January 1976, the survey found that 
differences in income and education were 2 percent or smallej*. As illustrated in 
Table 3, household income, education and other variables closely approached the 
same levels for total households and telephone households. 

To be sure, there are still limits on obtaining samples of some populations, a 
few Dockets around the country are not yet saturated with telephones— notably 
Mississippi, with 76 percent of all households with telephones in 1972. But the trend 
is unmistakable and sharply upward even in these areas. If a survey is exclusively 
targeted on a subgroup known to have somewhat fewer telephones, differences that 
are relatively trivial for a general survey take on major importance for the study 
of a smaller group. Taking the very poor for an example/ a difference of 2. 1 percent 
of the total population becomes a bias of 15 to 20 percent if poverty households were 
the sole focus of the study. There remains, however, no substantive reas()n not to 

** Alfred J. Tuchfarberand William R. KlfCka, Raminin Di^it l)H^lltl^: Ltun'tni^ tfu' (nsf f>/' Vii'dtni 
joMo/i Si/rrm. Police Foundation, Wasliin^on. I) (\. 1977. 
' A 1975 reported liousehold income under $3,()(M). 




Table 3 

^jsTics OF Households with a Telephone Availablk 

VERSUS All Housrholds Nat^ion^^ide: 1970 and 1976 



Household Characteristics 
by Year. * 



Percentage 



Telephone All Difference 




r 



1970:^ 

Household Income 

Less than $3,000 
$3»000^ $7,499 
$7,500^-19,999 
$10,000 -$14,999 
$15,000 -j$24,999 
$25,000 or more 

Race of Head 

White and other 
Black 

Edufta tion of Head 

0 — 8 yeirs 
9 — 12y^ars 
Morefnan 12 years 

1376:^ 

Hou sehold Income 

Ussihan $3,000 
$3,000 -$7,499 
$7,500 -$9,999 
$10,000 -$14,999 
$16,000 -$24,999 
$25,000 or more -\ 

Race of Head 

White and other 
Black 

Education of Head 

6 8 years 
9-*- 12 years . 
More than 12 years 



14.3 
"26.9 
15.2 
/ 24.7 
f 14.6 
4.2 



91.8 
8.2 



24.1 
47.4 

28.5 



16.7 
!J9.1 
14.8 
22.7 
13.0 
3.7 



89.7 
10.3 



26.8 
47.1 
26.1 



2.4 
2.2 
0.4 
2.0 
1.6 
0.5 



2.1 
2.1 



0.3 



2.4 



9.3 






2.1 


24.U 


'-.26.2 




1.9 


1 2.«^ ^ 


12.8 




0.0 


24.9 


23.4 


+ 


1.5 


21.4 


19/7 


+ 


1.7 


' 7.2 


' :6.i:) 


+ 


0:7 



r-. 

90.8 
9.2 



19.5 
45.1 
ig.4 




6^p..^4; 197(VU.S! Census, 



aSOURCE: Tuchfarber and Klecka, 
1 in 10,000 Public Use Sample tape, • 

''SOURCE: Tuchfarber and Klecka, 1976, p. ^6; LEAA National 
Crime Survey, January 1976 panel, p. 26; based on 10,043 interviewed 
households. < " ^ ' _ 
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presume that telephone households provide an unbiased pool from which to sdmple' 
for general population surveys. ^ 

As can be seen from the data presented here, the view that telephone 
households are not representative of the general populaticii vyas accurate as re- 
cently as the 1960s, but the spread of the telephone into low-^nco'me homes has 
outdated that crjiticism: For most purposes, the evidence that the universe of tele- 
phone households is an acceptable representation of all households is now rather 
compelling. It is therefore appropriate to consider in turn the other criticisms of the 
telephone survey— its sampling procedures and the reliability^ data. 

To accomplish this task,- the report will both review the avafibble literature on 
telephone interviewing and draw upon 3,042 interviews in seven western Pennsyl- 
vania cities. Part of aistudy of the mass media and political awareness, these data 
include between 400 and 5^0 telephone interviews in each of five cities. In the two 
remaining cities^ the sdrvey- was conducted both by telephone and by personal 
interviews in respondents' homes, and allows a comparative assessment of tele- 
phone and in-person interviews. The three sections which follow wilPcbnsider 
sampling iss^ies, comparative telephone and persona) survey responses, and some 
manager^ent issues relating to quality control. The general format of th^study is 
to first review the literature on these issues and then to analyze tii^ relevant 
Pennsylvania survey data. 



2. SAMPLING ISSUBS AND TELEPHONE SURVEYS 



I ■ 

All survey methodologies mart find ways to obtain representative samples. 
Without a complete" and currentliating of the entire population, a pure random 
sample cannot be obtained. Consequently, one must rely on a series of approxima- 
tions and pragmatic compromises to obtain a probability sample. It is important, 
therefore, to examine the practical steps that ure taken in drawing and obtaining 
a telephone survey sample, anc to consider their cumulative effect in providing a 
representative sample. Since the record shows that techniques such as area proba- 
biMiy sampling'for personal surveys of households have Achieved generally repre- 
sentative samples, it is also instructive to contrast the relative strengths and weak- 
Inesses of these two survey methods; . . ^ . . • , , 

! First we shall review the sampling procedures involved in obtaining a tele- 
phone sample, including the development of a sampling frame, the choice of 
households, within-household selection, and refusal rates. Telephone survey data 
collected in western Pennsylvania will be used to show tl^e cumulative effects of 
these procedure* on sample bias. Then to compare area probability sampling and 
random-digit dialing, we shall touch briefly on the major differences m the proce- 
dures employed ahd, again using western Pennsylvania data, show the compara- 
tive, cumulative results. • 



THE TELEPHONE DIRECTORY AND UNLISTED NUMBERS 

While telephone households have" come to closely reflect the characteristics of 
the population as a whole, households listed in telephone directories are less repre- 
sentative because of unlisted numbers. Directories provide biased samples, and the 
problem has gotten worse rather than better since the 19608 as large proportions 
of telephott users chbose not to liflt their numbers in the directory. In addition to 
numbers ulTlisted by choice, the high mobility of the American population means 
many new telephone numbers are operational but not included in current published 
directories. In one study. Cooper learned that up to 18 percent of the total sub- 
scribers in Cincinnati were not listed-€ perxient by request and 12 percent because 
their telephone had been installed since the last directory was issued.' An unpub- 
lished Illinois Bell study showed that 20 percent of all Chicago customers were not 
listed'' In a study of Toledo subscribers, Brunner and Brunner found 13 percent 
were voluntarily unlisted." They went on to contrast the characteristics of 
households which were listed with those which were voluntarily unlisted, and 
found seveVal modest but significant diflferences. Unlisted subscribers tended to be 
somewhat younger, less affluent, less educated, more in blue-collar occupations 

• Sanford L. Cooper. "Random SumplinK by Telephoni-An Improved Method." .]ourmx\ of Marhvt- 
inn Hvmin-h, Vol. 1, NovemlH?r 1964. pp. 45-48. 

Cited in Robert C. Judd. 'Telephone Us^.^e and Survey Research, .hurnul of A</r*-r(isiri« K. • 
.s.'«n/i. Vol. 6. December 1966. pp. 38.39. ' , o u i u . lu 

' .iames A. Brunner and G. Allen Brunn.T. 'Are Voluntarily Un isUul Tj- ephone SuKscr.her.s Really 
Difreient?"./o«rn«/ of MarketinM fiMmrch, Vol. 8. }<ebruary 1971, pp. 1^M^4. 
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than were listed subscribers. A subsequent study of the Toledo area replicated these 
findings and found some media habits differed between listed and unlisted sub- 
scribers.'* Leuthold and Scheele's survey in Missouri supported these findings, but 
also found a strong'lJropejisity toward unlisted numbers among blacks. They also 
found that city dwellers were^re likely to be unlisted and unlisted numbers were 
also relatively more likely among younger people, union members, and apartment 
renters.^ 

National data on the demography of unlisted numbers also found similar racial 
and economic differences. Glasser and Metzger reported on four national t^elephone 
surveys v/hich reached respondents by random-digit dialing and asked, "Is your 
telephone number listed in the current telephone directory?''® They found that the 
national rate of non-listed phones v/as close to 19 percent. Non-whites were twice 
as likely as whites not to have listed telephones. Nationally, urbanized areas had 
more non-listed residential telephones (24-29%) than did small and rural counties 
(9-16%). However, **contrary to popular belief, the lower and the highest income 
groups consistently showed lower than average incidence of non-listed 
households/'^ The middle income group ($5,000 to $9,999) consistently had the 
highest proportion of telephones that were not listed. As in their 1972 report,* 
Glasser and Metzger found numbers were listed less frequently in the West and 
among younger {People (ages 18-34). Blankenship reported that surveys conducted 
by three large l^eseach firms indicated especially high proportions of unlisted tele- 
phones were likely among households in the West, in Idtge metropolitan areas, with 
younger heads, and in middle and*, lower middle income brackets ($5,000 to 
$15,000).* The research findings concur that listed telephones are unlikely to be 
representative of all telephone subscribers and that some alternative is necessary 
to obtain a sample of telephone households. 



PROBABILITY SAMPLING TECHNIQUES FOR TELEPHONE 
SURVEYS ' I 

Since dialing numbers listed in the directory leads to a biased sample, numbers 
must be generated in a manner which includes a reptesentati . e proportion of 
unlisted telephones.^® To dial seven-digit random^ numbers would be wasteful be- 
cause thousands of not-in-service telephone numbers woul^ be called. Surveys can 
take advantage of the fact that telephone numbers are assigned by three-digit 
exchanges arid, \yithin exchanges, consecutively within blocks of 1,000. 

* Sydney RohIow and Laurence Roslow. "Unlisted phone Subst'ribers are Different." Journal oj 
AihWtmni^ HeHvarvh, Vol. 7, Aujfust 1972» pp. 35-38. 

David A, Uuthold and Raymond Scheele. "Putlerns of Bias in Saniple.s Bnsed on Tekplinru' 
DirectorieH." Puhliv Opinion Quarterly. Vol. 35. Summer 1971. pp. 249-257. 

* Gerald J. Glasser and Gale D. Metzger. "National PJstimates ofNonlisted Telephone Housefmlds 
and Their Characteristics/' ^Journal of Marketing HcHcun h. Vol. 12. August 1975, pp. 359 ;i«l 

' Ibid., p. 36(). 

" Gerald J. Glasser and Gale D. MetZK^r* "Handoni-Digit Dialing as a Method of'Teleplione Sam- 
pling'." Journal of Marketing Research. Vol. 9. PVbriuiry 1972. pp 59.()'l. 

" A. B. Blankenship, ''Listed versus Unlisted Nunibern in Telephone Survey Samples/' Jnurnol of 
AiiveriiHtHfi ResearvK Vol. 17. February 1977. pp, 39-46, 

' One exception would be an exclusively rural and small town Hurvey where unlisted phones are 
under 5 percent: the small decrease in bias from random dialing would probably not be wort h the .^a vine's 
of using the directory. 
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Using the exchanges as a starting point, one approach to random-digit dialing 
involves generating four random numbers to add to the exchanges in an ar^. A 
modification of this approach is more efficient since many exchanges do not use all 
ten blocks and there is no point in randomly generating thousands of telephone 
calls to blocks not in service. Given that unlisted numbers are usually distributed 
throughout all exchanges and blocks, the directory should provide a valid source . 
of operating exchanges and blocks weighted by the proportion of telephones located 
in each exchange and^'block. Thus three random numbers are inserted ont<^ a 
three-digit exchange and one^iigit working "block". A number (781-2436) is drawn, 
the exchange and block retained (781-2), three random digits generated (799), and 
a^ded'to the original stem to get a number to be called (781-2799)." 

One further variation of the random-digit approach will be referred to as "ad- 
ded-digit dialing." This method takes residential telephone numbers from the direc- 
tory at regular intervals. Onto these seed numbers are added one or rtore constants 
to the last digit so that each directory number generates one or morejiew numbers 
for the sample." Banks of numbers are thus self-weighting, and if there are fewer 
numbers within a bank, it is less likely to be drawn. Unused banks are never chosen 

or dialed. v " 

Added-digit dial'nT poses two potential problems. In rapidly growmg cities, 
whole Jiew banks may be opened up after publication of directories. A system 
relying on th6 directory for the first several digits would omit these new telephone 
homes. Mobile and neW residents in the community would then hs underrepresent- 
ed. Also, in instances where unlistfed numbers may be grouped together rather than 
distributed randomly throughout exchanges, added-digit dialing would under- 
represent such numbers. Social scientists can usually obtain estimates about the 
magnitude of these problems from local telephone companies. In the Pennsylvania 
survey neither of -these problems were found. Telephone company officials 
confirmed that unlisted phones were evenly distributed throughout Pittsburgh 
area exchanges, and' that ho new banks of numbers had been opened up in any of 
the exchanges since publication of the most recfent directories. Under these circum- 
stances, added-digit dialing should provide an unbiased probability sample of all 
listed and unlisted residential telephones. 



SELECTING AND OBTAINING WITHIN HOUSEHOLD 
RESPONDENTS 

The initial contact is a critical point in the telephone survey because the inter- 
; viewer must both elicit the cooperation of the person telephoned anddetermine the 
ajipropriate member of the household to interview. Once someone answers the 
telephone, the interviewer must decide who at that number should be interviewed. 

If the research design calls for interviewing only heads of households or work- 
ing women or elderly people or some other particular population, a specialized 

" Sanford L Cooper, op. cit.: Gerald J. Glasser and Gale D. Metzger. op.cit.; and J. O. Eastlack and 
Hunry AsKiel. "Belter Telephone ,;urveys Through Centralized Interviewing." .hmrnal'of AdwrUsinn 
HvHearrh, Vol. 6, March 1966, pp. 2-7. , • 

'» Sevmour Sudman. 'The Uses ofTelephone Directories for Survey Sampling." 'humal of Matihvt- 
inn KeitPorch. Vol. 10. May 1973. pp. 204-207; Matthew Hauck and Michael Cox, "LocatinR a Sample 
hv K<indom Di(tit Dialinn." Public Opinion Quarterly, Vol. 38. Summer 1974, pp. 253-260. 
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screening procedure is required. Other surveys, rather than interviewing whoever 
answers/must employ some general formula, preferably involving random selec- 
tion of respondents within households. One of the most difficult and problematical 
issues in the design of telephone sampling procedures is the trade-off at this point 
between short systems that minimize refusals, and complex systems^hat maximize 
the representativeness of within-household selection. 

A common standard forjudging within^household selection js that advanced by 
Leslie Kish. Developed for personal interviewing, his technique requires the re- 
spondent to name all members of the household and to list them by sax in order 
of their ages.^' The appropriate respondent is then chosen based on a table of 
random distributions. However, to ask questions immediately about the exact 
composition of the household increases the probability that the person answering 
the telephone will refuse the interview and hang up. Hauck and Cox found that 
obtaining a list of family members, ages, sex, and relationships early in a telephone 
interview was quite difficult. They concluded that 'Vapport building, before at- 
tempting to obtain family composition seems essential.'''^ More detailed selection 
probing seems to prompt increased refusals* Consequently, the search has been for 
selection procedures that can^ffer the most precision with the fewest possible 



^ Troldahl and Carter offered a quicker and simpler reformulation of the Kish 
method for telephone interviewing which involved only two questions: How many 
adults in the household? How many are men? For each interview,^^a table then 
shows who should be interviewed. They suggest four versions of their selection 
table,** but this number leads to some bias. Their system must oversample one type 
of respondent in households with three adults. Also, in households with three or 
more adults of the same sex, only the youngest or oldest are called for, leaving some 
-people with a zero probability ofbeing selected.** Together they estimate these two 
factors lead to a potential 5 percent error in the selection of all eligible adults. As 
Paisley and Parker point o\% the error caused by using^only four vei*siohs of the 
selection table can be avoided by using sixty tables. Ea,ch questionnaire is assigned 
one of the 60 tables before the interview, and on balance every adult household 
member, at least in households of up to five adults, has an equal probability of being 
chosen. • ^ 

Bryant has argued that new population trends result in large oversampling of 
women using the Trohldahl and Carter tables. Coupled with the usually greater 
non -esponse rates of men, the proportion of male respondents is likely to be sharply 
reduced.** Bryant reports on experiments which manipulated the selection forms 

i- 

' Loslic Kish, "A Proceduie for Objective Respondent Selection Within the llousehold." Anwrtcan 
SiatiMwal AHHm'iaiion Journai Vol, 44. 1949. pp. 3^}()-387. 
Matthew Hauck ancTMichael Cox, op, cit. 

Verling C Troldahl and Roy E. Carter, ''Random Selection of Respondents Within Hou.seholds in 
Phone Surveys," Journal Marketitifi Reneareh, Vpl. 1, May 11)64. pp. 71-76. 

Backstromand Hursh suggested a ai.^-table model that includes the middle aged people in multii)l<'- 
adu!t households omitted in the Troldahl and Carter and randorti samples in three member housi»hol(ls: 
four and five-adult households are not randomly sampled, however Charles Backstrom ^mi Gerjild 
Hursh, Survey Rfsfarrh, Northwestern Press. 1%3, pp. 52-58. « \ 

William J. Paisley and Edwin B. Parker, "A Computer Generated Sampling Tuble for Selecting' 
Respondents Within Households/' Public Opinion Quarterly. Vol. 29. Fall 1965. pp, 431-436. / 
"* Barbara E. Bryant, ''Respondent Selection in a Time of Changing liousehold Composition," Jour ' 
. nal of Marketing Researvh. Vol. 12. May 1975. pp, 12:M35. / 
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in order to increase the proportion of males interviewed. While some modi .cations 
achieved a more satisfactory percentage of malp respondents, to the oxtent they 
required calling for a disproportionate number of men to offset refusal rates, the 
tables were no longer random within-household selections but a quasi-quota sam- 
ple. 

Qne system which attempts to balance the necessity for random respondent 
selection with a minimum personal opening interrogation is a "desi^Tiated sex" 
assignment for each household, This approach was used for the Rand Pennsylvania 
survey. 

The designated-sex method specifies that the sex of the appropriate adult re- 
spondent for each household is assigned in advance. Any adult of the designated, 
sex living 'n the household may then serve as a valid respondent. Thus, interviews 
either simply ask for an adult of the sex opposite that of the pe^rson answering the 
telephone or else they proceed with the interview of the adult answering the 
telephone. This designated sex approach is based on the fact that almost three- 
fourths of all American residences consist of husbands and wives, or single males, 
or single females, as the only adults in the household. For all such households, the 
designated sex method produces precisely the same random sample as would more 
complicated techniques. j i • 

The extent to which this method creates a non-random respondent selection 
among the remainder of the households is a function of the number and sex of the 
adulis in each household. Three-person households, for example, with a husband, 
wife, and one other adult constituted 15 percerit of all hoi(seholds in the Pennsyl- 
vania sample. Among such households alternating the designated sex of respon- 
dents would result in an ideal selection two-thirds of the time. The spouse of the 
sex opposite that of the two other adults in the household would be oversampled 
one-sixth of the time. The member of the sex represented twice in this three-person 
household who is more likely to stay at home or to answer the telephone would be 
potentialljf oversampled one-sixth of the time. Extending these calculations to all 
househofd-composition types in the Pennsylvania survey indicated that the desig- 
nated-sex method directed interviews to the same respondent as would a random 
table in all but 12 percent of the households. If the simplicity of this selection 
procedure can avoid driving up the refusal rate, that advantage may be more 
important than the bias connected with the 12 percent of within-household selec- 
tions that would have been different under a complex selection system. ^ 

The presumption of such an advantage led to the use of the designated-sex 
approach in the Rand-Pennsylvania survey. However, its actual effectiveness in 
reducing refusals is uncertain. Little is known about the relative effe'cts of this and 
other within-household selection systems on telephone refusal rates. Field experi,- 
n^ents are needed to systematically contrast the effects of different methods: Dill- 
man, Gallegos, andFrey, for example, examined the impact on refusals of various 
kinds of opening remarks about the importance and nature of the survey..'" More 
such telephone studies are required for opening remarks in general and for within- 
.household respondent selection procedures in particular. — 

Don A. Dillman. Jean Gorton GalleKo«. and James H Frey. "RedunnK Refusal Ratfs lor Tele- 
phone Interview.s." Public Opinion (iuurterl^. Vol. 40. Spring 19^76. pp. 66-76, 



REFUSALS 



High refusal rates are a problem both in the United States and abroad. 
'^Completion rates" and ''refusfil rates" are calculated in a variety of ways. Often 
they are computed as a proportion of all telephone numbers employed in the study 
so that t ley become an artifact of such factors as the proportion of business num- 
bers in tne exchanges dialed, whether or not people living outside the central city 
were eligible respondents, and the nature of within-household respondent selection 
procedures. This report recomputes *Vefusal rates" as the proportion of all contact- 
ed eligible respondents who Refuse to be interviewed. 

Even using this standardized definition, true refusal rates are often difficult to 
calculate for telephone surveys. Unassigned telephone numbers sometimes ring as 
though they were regular working numbers, and so distinguishing invalid numbers 
from uncontacted households is not always possible. If a screening question is 
needed to identify a particular type of respondent, calculation of the true refusal 
rate^is difficult since many ineligible individuals will also refuse to be interviewed 
before one can learn their eligibility status. In the Rand Pennsylvania telephone 
surv^, for example, a high percentage of the numbers in exchanges in the targeted 
cities included residences outside the city limits. Over half of those who appeared 
willing to be interviewed Mved outside the designated cities. Of those/ who immedi- 
ately refused to be inter^ lewed, presumably a comparable proportion also were 
actually ineligible by virtue of their place of residence. If the refusals may be 
discounjted by the ratio of jurisdictional eligibility to ineligibility found among 
others, ^ estimate of the telephone refusal rate may be computed. The estimated 
proportion of all eli::ible respondents who refused to be interviewed over the tele- 
phone was 28 percent. 

Thjgjevel isrcomparable to those in many other surveys, using the standardized 
definition of refusals. For example, Wiseman reported 36 percent refusals over the 
telephone, and 40 percer\^t in person.'' Hauck and Cox indicate a telephone refusal 
rate of 35 percent.'* IrTCleveland, Sudman had refusals of 17 percent in telephone 
interviews and 23 percent of personal interviews, which compared favorably with 
the 27 percent in the top ten metropolitan areas and 22 percent in Chicago refusing 
personal interviews conducted by the National Opinion Research Center.'^ In the 
first few weeks of their telephone survey, Eastlack and Assael had refusal rates of 
30 to 40 percent.*^ As the survey progressed and poor interviewers were removed 
the refusal rate went down to 20 percent or less. . 

Refusal rates for telephone surveys thus vary around a third to a fourth of the 

> . ■ ■ 

" Report of a WorkinK Party on the Market Reaearch Society's Refw?arch and Development rommit- 
tee. "Response Rates in Sample Surveys," Journal of Sfarket. Research Society, Vol. 18, No, 3, 1976, pp. 
1 13-142, Despite the genera) impression that refusal rates have ^own worse, Kent Marquis show.s that 
there has been no substantial increase in refusals in the United States. ^'Survey Response Rates: Sonio 
Trends, Causes and Correlates," The Rand Corporation, P-5863. April 1977. See also. Don A, Dillman. 
Mail and Telephone Data Collection Methods, Wiley lntorscience, New York, forthcoming' 

" Frederick Wiseman, ''Methodological Bias in Public Opinion Survev.s," Puhlir Opinion Quarterly 
Vol. 36, Spring 1972, pp. 105-108. 

" Matthew Hauck and Michael Cox, op. cit, 
" Seymour Sudman, op. cit. ' 
*^ J. 0. Eastlack and Henry Assael, op. rit. 
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eligible respondents contacted, but there are exceptions." A few studies, some 
involving telephone reinterviewing, report reducing refusal to less than 15 percent. 
These include Weller," Cooper?^ Hochstim." and Schmiedeskamp." At the other 
extreme, they can be very high. Falthzik discusses a survey of women in some of 
the Maryland surburbs of Washington D.C., in which refusals reached 52 percent. 

The consequences of high^refusal rates depend on the extent to which refusals 
are associated with relevant respondent characteristics. Using telephone survey 
data, the effects of refusals and the other telephone sampling issues can be exam- 
ined using five telephone samples collected in western Pennsylvania. 

SAMPLING PRECISJON IN FIVE CITY TELEPHONE 
SURVEYS V 

The impact of telephone survey methods on the representativeness of the final 
sample is the joint effedt of four factors which have just been discussed: (1) the 
extent to which telephoAe households reflect the entire population; (2) the extent 
to which an unbiased sample of all listed and unlisted telephone households maV 
be achieved- (3) effects of within-household respondent selection techniques; and (4) 
noncompletion rates, including whether the selected- respondent can be found at 
home and refusal rates. Data and findings reviewed here imply that little bias 
should emerge at least from the first two factors. Potential bias from withm- 
household selection and differential refusal rates, along with the cumulative impact 
of all four factors, are of the greatest concern. 

The data to be used to report on the validity of telephone samples are drawn 
from a survey of seven cities in Pennsylvania conducted in September and October 
1976 Appendix A describes in detail the procedures employed in the survey, but 
briefly the survey was conducted in a way and under conditions similar to many 

telephone studies. , . z-^u *• 

The penetration of telephones in the seven citiep was close to that of the nation 
as a whole, and exceeded 90 perceo^t in most cities. Added-digit dialing was em- 
ployed to draw the sarpplc. Teleph6h«^ numbers were drawn from published tele- 
phone directories and 'a constant was added to the last digit. 

Up to five telephbne calls to a number were required in order to reach the 
eligible respondent, and respondents were selected by means of the alternating 
designated-sex approach described earlier. When the person who answered the 
telephone was the predesignated sex. the interviewer proceeded immediately. If 
not, the interviewer asked to speak to a person of the opposite sex. The calls were 

" Advance letters solicitinR cooperation and exF)laininK the importiincf of the survey have been 
shown to ubTtant a IvTeduc refunal rate«. Althougi; they cannot^be used w,th random-diRit or ad(L ()• 
S SiaVng Slice lette^rrnay be «Cnt when the addresses of respondents are known m advance. See 
Don A. Dillman. Jean Gorton C.alleKos. and James H. Frey. op. clt. - 

"'Tom Weller. 'Telephone Interviewing Procedures." Survey ftWarch, Vol 5. No. 1. Januarv 
pp. 1314. \ 

Sanford L. Cooper, op. cit. \ . r J u . ■ n . 

" Jos^-ph R Ilochstim. "A Critical C<.n>p<.ri.son Three SuVejoes "[^^"»;;^"5« "i'J" ^'""^ 
, Households." American StatM Amn iati'm .hunml. Vol. 62. SepteniluT 1%7. pp. 9Zb-9H9. 
• " Jav W. Schmiedeskamp. op. cit. ^.^ p Vni n 

Alfred M. Falth/.ik. "When to Make Telephone Interviews." Jounwl of M«rferfin« Research. Vol.H. 
November 1972, pp. 451-452. 
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conducted hy interviewers calling long distance from the central WATS facility of 
the Opinion Research Corporation in Princeton, New Jersey. Rand and ORG jointly 
supervised the work more closely than is probably common in market research. If 
one includes as refusals all respondents who began but prematurely terminated the 
interview, the final telephone refusal rate among eligible respondents was approxi- 
mately 28 percent. Disentangling the extent to which vaHous factors biased the 
final sample is infeasible with this survey. Of interest is the net impact of all 
sampling and selection procedures on the resulting sample. 

Measurement of sample bias is complicated by response bias and by outdated 
census comparisons. Some variables are more likely than others to include response 
bias, so error could result as much from inaccurate responses to questions as from 
sampling bias. Questions about respondent income are particularly difficult to ask, 
and will be treated in detail in Section III under response reliability. Also, the 
census data were six years out of date at the time of the survey.^' Thus, standards 
of comparison are somewhat, unstable.. 

The results of the five city purveys where samples of 400 and 500 respondents 
were collected nonetheless show a substantial congruity between the telephone 
surveys and available data on the city populations." Table 4 compares results of 
the telephone sampling procedures and 1970 population characteristics of the five 
cities. The telephone sample was within two standard errors of the Census percent- 
ages of blacks and other non-white races in each city but Johnstown. Since good 
estimates of proportions' on the ofder of 10 percent are usually difficult with small 
samples, the accuracy of the estimates of government workers is also important to 
note. The average absolute error in these estimates was less than 2 percent. In two 
cities, statistics were available on the city wide subscription to cable television 
services. In McKeesport, 44.3 percent of city households were on the cable com- 
pared to 48.0 perpent of the telephone. sample. The 88.3 percent of Williamsport 
households with cable television was close to the 90.8 percent in the Rand survey 
who said they had cable televisioh. Again» both sample estimates are within two 
standard errors of the city proportions. 

- Turning to measures more likely to induce overreporting, Table 5 shows the 
proportions of adults who recalled they had voted in past elections and said they 
were registered for the 1976 elections. Previous research reveals that voting)recall 
is consistently 5 to 10 percent or more higher than official figures.^^ Anything 
substantially greater would indicate the telephone survey oversampled the part of 
the population that actively vote, while no differences or lower recalled levels of 
voting would mean that the less active had been oversampled. In all five cities on 
all three voting-related measures, however, the telephone sample shows a consis^ 
tently modest overreporting in the range of what prior research would predict for 
a representative sample. Only two instances lie outside a 4 to 9 percent overreport- 

\ Tables 4 and 6 report 1970 Census figures without any extrapolation.s, aloii^' with ciible trU'visiori 

\ figures provided by local CATV managements. City registration and votm^' H^iurivs fbr Tahles 5 and 7 
\ came from the offices of the county clerks, and the number of* adults by city in \97^ used to ralculHte 
\ proportions are based on linear eJrt^apolutions from 1970 and 1973 Census data. 
\ Given the traditional concern with telephone undersampling of low-income families, the reader 
^lay wish to refer to Table 10 to see that there was also no apparent hi^^h-inconie hia.s in the final 
telephone sdniple. 

\ Auge R. Clausen, "Response Validity: Vote Report," Public Opinion QuartorLy. Vol. Ml^./Winter 
19f>8-69, pp. 588'6fX); and Blair T. Weir. 'The Distortion of Voter Recall," Atm'rmm Jdurno/ nf t'nlitu ul 
SrUmce. Vol. 19. February 1975. pp. 5;i-6;). 

\ 
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Table 4 



Comparison of Telephone Survey Estimates with 
Population Characteristics 
(percent) 







Rand 


Survey 










Standard 




Popui&tion Characteristics 






Error 


Difference 


Blacks 










Greensburg 


1.4 


1.5 


± 0.6 


0.1 


Johnstown 


6.5 


4.U 




-OK 

z.o 


McKeesport 


10.5 


8.2 


z i.z 


- 0 o 


riivSDurgn 


20.7 


16.9 


± 1.9 


- 3.8 


Williamsport 


3.2 


2.8 


± 0.8 


- 0.4 






Rand 


Survey 






1 Q7n 




Standard 






Census 


Estimate 


Error 


Ditference 


Government employees* 










Greensburg 


11.8 


11.3 


± 1.8 


- 0.5 


Johnstown 


11.8 


11.2 


±1.6 


- 0.6 


McKeesport 


12.0 


9.2 


± 1.5 


- 2.8 


Pittsburgh 


14.9 


16.0 


± 2.1 


+ 1.1 


Williamsport 


9.3 


12.8 


± 1.9 


+ 3.5 






Rand 


Survey 






1976 










Cable 




Standard 






Data 


Estimate 


Error 


Difference 


Subscribing cable 










households^ 










McKeesport 


44.3 


48.0 


i 2.2 


+'3.7 


Williamsport 


88.3 


90.8 


± 1.4 


+ 2.5 



"Government employees as percent of employed heads of households. 

''Service estimates provided by local cable operators. The number of 
subscriber households was divided by total city households. Data not 
avcilable for Greensburg, Johnstown, and Pittsburgh. 



ing of having voted in the 1975 local elections, and the disparity may be attributable 
to special elections that year in addition to the regular November municipal 
elections, rather than to the telephone sampling technique. 

Thus, the overall sample characteristics for each city were acceptable represen- 
tations of the adult populations. Reasonable estimates of population characteristics 
were obtained by drawing samples of 400 and 500 respondents from telephone 
households; using added-digit dialing, four telephone callbacks, designated sex with 
quotas, and holding the refusal rate to 28 percent. Having reported that result in 
,five city samples, we can turn to the other cities in the western Pennsylvania study 
to compare telephone and personal surveys. But first, sampling procedures usually 
associated with face-to-face interviews in households should be reviewed. 
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. ^ Table 5 / ' 

Comparison of Telephone Survey Estimates with Election Re^jords 

I (percent) 



Rand Survey 

Election Standard 
V oting Activi t y Records' E stimate Error Difference 

Voted in 1972 



National Election 










Grecnsburg r 


55.6 


61.6 


± 2.4 


+ 6.0 


Johnstown 


57.4 


61.5 


± 2.1 


+ 4.1 


McKeesport 


58.9 


62.7 


± 2.2 


+ 3.8 


Pittiibiirgh 


58.1 


66.6 


± 2.4 


+ 8.5 


Williamsport 


52.0 


60.2 


± 2.4 


+ 8.2 


Voted in 1975 










Local Election 










Greensburg 


37.9 


44.3 


± 2.5 • 


+ 6.4 


Johnstown 


47.7 


50.8 


± 2.2 


+ 3.1 


McKeesport 


45.7 


54.8 


± 2.2 


. + 9.1 


PitUburgh 


37.0 


51.4 


± 2.3 


♦• 14.4 


Williamsport 


37.0 


50.5 


± 2.5 


+ 13.5 


Registered in 1976^ 










Greensburg 


61.6 


66.2 


± 2.3 


+ 4.6 


Johnstown 


66.2 


68.3 


± 2.1 


+ 2.1 


McKeesport 


71.0 


74.7 


± 1.9 


+ 3;7 


Pittsburgh 


72.2 


75.3 


± 2.2 


+ 3.1 


Williamsport 


69.9 


67.7 


± 2.3 


+ 7.8 



^Turnouts and registration were divided by Census projections of 
the total number of adults in each city that year to obtain the«percent- 
ages of adults who voted and w;jere registered 

^Data only available for November, after registration was closed. 
Survey estimates are for September-October. 



PERSONAL INTERVIEWS AND CLUSTER SAMPLING 

Personal interviewing where interviewers question respondents face-to-face at 
the respondent's home is the dominant survey research method in the social 
sciences. Personal interview sampling procedures require a series of practical com- 
promises that diverge from the ideal of a random sample. In contrast to the tele- 
phone sample, the typical persona! survey uses a cluster sample approach which 
keeps down costs. But the area clustering of interviewing has an inherent statistical 
weakness that often increases sampling error. 

National, state, and large metropolitan surveys rely on multistage area proba- 
bility sampling procedures that select types of geographic units weighted according 
to their population. Thus a national or regional survey will assign a fraction of the 
total interviews being planned to represent proportionately the very largest cities, 
large metropolitan areas, small metropolitan areas, and counties without cities. 
These interviews will then be collected in '^clusters'' of perhaps a dozen interviews 
each. Thus, for examples, in a total sample size of 1,500 interviews, if 300 must be 
collected in counties with6ut small cities and the cluster size is to be 12, then 25 
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clusters must be identified in such countries. Twenty-five census districts would 
thus be randomly selected in rural areas (under regional quotas)." 

Personal interviews arc collected in "clusters" within.small geographic areas 
in these census districts.. Typically for each census district, a smgle household 
address is selected, and interviewing begins with a respondent in an adjacent 
household." Starting from that adjacent household, the remainder of the cluster 
is chosen following predesignated rules. Over years of experjente, detailed rules 
.have been developed to handle apartment houses, vacant buildings, dead-end 
streets, and new construction. Cluster listing of households can bt don* by^super- 
vispry personnel before the interviewing begins but in many cases It is trusted to 
the interviewer. In either event, it is essential that the selection - n ^t influenced 
by the interviewer's preferences as to what households he or she would like to 
interview. The requisite number of interviews is then completed in each geographic 

cluster. L ^ r 

Personal surveys employ the clustering approach in order to keep the cost of 
interview time within bounds. Concentration of interviewing within a series of 
clearly defined areas reduces time and travel costs both for the initial contact and 
for callbacks. This means that most alternatives to cluster sampling would prohibi- 
tively inflate the costs of personal interviews. Telephone sampling, it should be 
remembered, is" under no such constraints. 

As Sudman discusses in his useful review of cluster sampling, homogeneous 
clusters can substantially increase the sampling error of a survey Using cluster 
sampling, the power of the sample to estimate the population is reduced in propor- 
tion to the number and size of clusters and the degree of within-cluster homog 3nei- 
ty. For example, if voting preferences were not geographically concentrated and 
were as heterogeneous as the total population, then large clusters would not pose 
a serious difficuity. But if clusters are homogeneous in terms of socioeconomic 
status, race or ethnicity, and these factors relate to the phenomenon under investi- 
gation, the cluster approach substantially decreases the sample's power to accu- 
rately estiHiate the characteristics of the universe being studied. 



COMPARATIVE SURVEY METTHODOLOGIES: THE BETHEL PARK 
AND WILKINSBURG SAMPLES 

In comparing telephone and personal surveys, it is important to remember that 
•both methodologies have certain limitations and advantages. In terms of sampling, 
this discussion has suggested that the actual universe sampled is almost identical 
for the two methods, and that the impact of refusal rates is likely to be comparable. 
Personal interviews, however, more easily permit a detailed within-household re- 
spondent selection procedure. On the other hand, personal interviews are almost 
always tied to some form of cluster sampling given the high costs involved in 
interviewing households scattered over a wide area. In contrast, telephone sam- 
pling of households does not depend on neighborhood clusters and can be random. 

Fur a discussion ofa national probtibility sample, set- U-slie Kish, Slui'vy SnmpUnii. John Wil.-y 
and Sons, New York, 1%7, pp. 148-173, 

" By .starting with the adjacent household, this approach minimizes bias that could come from llic 
ab.sence of new construction on rt-sidential listin^js. 

'".•Seymour Sudman. / oplivdHuinplinn, Academic [Vess, New York, 1976, pp. 69-H4. 
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The question then is what is the net effect of these limitations an(i advantages 
on the final sample obtained by each approach. The Rand Pennsylvania survey 
permits us to address this issue because its design included the collection of com-^ 
paratiye data in two different cities. Half of the 400 interviews in Bethel Park and 
half of Xhe 400 Wilkinsburg interviev^s were collected by telephone using the same 
procedures employed in the other five city telephone surveys. The remaining 200 
interviews in each ot these two cities were coUected^by personal interviews. Those 
two cities'were selected^because, based on their different demographic character- 
istics, they appeared to repiresent two different contexts for survey research. Bethel 
Park is a growing, affluent cohnxxjinity, with many middle- and upper-class citizens. 
Wilkinsburg is a predominatly blue-collar city, with a varied socioeconbmic mix. It 
has a growing black population, and some declin>ng neighborhoods that are as- 
sociated with a variety of interviewing problems both for telephone and for per- 
tonal interviews. These two cities represent the two circumstances under which the 
two data collection techniques would most be expected to produce divergent 
findings for reasons of sampling and respoif&e rates. 

In both ,cities, personal interviewing was conducted concurrent with the tele- 
phone survey apd employed exactly the sartie within-household respondent selec- 
tion procedures and the same questionnaire. The only difference was that one 
survey was conducted face-to-face and used cluster sampling, while the other was 
over the telephone and used added-digit dialing. In each city, the personal inter- 
views were collected in,25 clusters with 8 completed interviews in each cluster. A 
starting point was designated for each of the clusters, and every second address was 
listed as a selected addrpss. Addresses where there were refusals, ineligible respon- 
dents, or where no one was at home after five visits were replaced by extending the 
listings in that clui^ter. Refusals constituted 18 percent of the eligible respondents 
in Bethel, Park and 24 percent in Wilkinsburg. 

When the results 9re compared, the most evident conclusion is that the two 
methods produced similar samples, with the telephone samples being slightly more 
representative of the population. In estimating the number of employed heads of 
household that are government employees, the telephone sujrvey was within one 
standard error of^the Census figure. Table 6 shows that the personal interview data 
underestimated that figure.^^ The telephone samples were good estimates of the 
number of homes subscribing to cable television, again within the standard erroju^ 
And again, the personal interviews w6re less accurate. The discussion of ilte(5me 
findings in Section III will also show that the distribution pf family incoii(es ob- 
tained in the Bethel Park and^in the Wilkinsburg telephony samples more closely 
reflected projection^ derived from the Census data than did the persbnal interview 
figures (Table 10). 

. Perhaps the most interesting ^difference between the telephone ancj^personal 
ijamples involved the race and home ownership of respondents. The results in both 
surveys were similar in Bethel Park where, accbrding to the Census Bureau, less 
than one percent of the 35,000 residents were black. By contrast, the results of both 

" An adjustment is made in computing the standard error for ihv personal intervie^s^mples as in 
Table.H 6 and 7. The true sampling error of cluster san.i^les drpends on the size of .the clu.steKan(j the^ ^ 
amount of homogeneity within clusters, since clusteniiK reduces the number of independent obsiVva- 
tions. See Sudman, op. cit., p. 76. Comparison of the standard errors in Tables 6 artd 7. where Uie 
telephone sampling error is computed assuming a random sample, show the statintical power lost by 
using a cluster structure. 
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.'T' ^^riatiM Characteristics 


Census ^ 


Estimate 


Standard 
Error^ 


Difference 
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• — ' — ^Bethel Park ' 

* Telephone S,urvey . 
^ >jL. Personal Survey 


0.7 ' 


^ 

0.5 
0.0 


± 0.5 

± d.o. 


> 

- 0.2 

- 0.7 




Wilkinsburg * 

Telepl^one Survey 
Pe^soi^.M? Survey 


t 

20.4 


34.4 
23.2 


± 3.4 
± 5.7 


• • 

14.0 
+ 2.8 . 


% 
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" •■■ 1 




. Band 


Survey, 






/ 


' 1970 
Census 


Estiihate 


Standard 
ErforC 


Difference 




* -<< — 

^ ^ Qovemment employees* 












Bethel Park ^ 
1 ^ w Telephone Survey 
Personal Survey 
•'Wilkinsburg 

Telephone Survey 
^ ' Personal Survey 


11.6 
13.4 


10.6 « 
5.0 

16-9 . 
9.9 


± 2.2 

± 3. a 

'± 2.9 
±4.8 


- 1.0 

- 6.6 

+ 2.5 \ 

- 3.5 
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Rand Survey 








1970 
Cable Data 


Estimate 


Standard 
ErrorC 


Difference 





SabscrijjiOfi cable 
househblds^ 

Bethel Park' 
^ Telephone Survey 
.Personal* Survey 

Wilkiiisburg 

Telephone Survey 
Personal Survey 



'49.3 



40.9 



52.1 


± 3.4 •• 


+ 2.8 ' ■ 


Hl.O 


± 5.5 


- 8.3 

r 


43.4 


±3.5 


+ 2.7 


35.0 


± 5:6 


- 5.9 -^v 



^ "Government employees ai^ percent of employed heads of households. ^ 

^Service estimates provided by local cable operators. The number of 
subscrilfer households was divided by total city households* Data not av&il- ^ 
able for dreensburg^ Johnstown, and I^ittsburgh. 

^The standard ^rror for the telephone survey is a straightforward calcula- 
tion based on the sample size and the assumption of a random sample. The 
personal survey error follows Sudman in adjusting th^standard error to re- 
Tlect the greater inaccuracy due to cluster variance. 
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surveys sharply differed with the 1970 Census report of the racial composition of 
Wilkinsburg. This differerfce in the Wilkinsburg survey is alsp correlated with 
differing telephone and personal survey fi'.dings on home rentals and home owner- 
ship.^® The telephone survey in Wilkinsburg found more renters than did the 
in-pers6n survey, a difference consistent with the fact that more blacks in Wilkins- 
burg were renters.. 

The consistent pattern of these differences suggests a systematic bias in one of 
the two rnethods. The variable of race can be contrasted with Census data. At first 
glance, looking at the 1970 Census figures on race in Table 6, the personal inter- 
views seem more accurate. Additional information indicated inst^4 that the tele- 
phone sample is a" superior estimate of the number of blacks in Wilkinsburg. The 
black population has grown rapidly. In lS70, according to the Census Bureau, 
Wilkinsburg was 20.4 percerit black — a 637 percent increase over 1960. Local ob- 
servers confirm that the black pi oportion of the population has continued to grow. 
^ but there are no official estimate? available. In 1970, about 30 percent of all Wilkins- 
burg public school children wpro black. In 1976, the superintendent of schocrTs 
^-estiipated that 54 percent were black. Based on these data, it seems certain that 
Wilkinsburg was substantially more than 20 percent black in 1976, and was prob- 
ably over 30 percent black. This evidence suggests that the telephone sample's 34 
percent black proportion is a more accurate reflection of the Wilkinsburg popula- 
tion than the personal interview sample's 23 percfent black. Not only does the 
telephone figure appear to be more accurate, but the telephone sample includes 
more blacks than the personal interviews. This is the reverse of what would be 
expected from the historic concern that telephone sampling underrepresents disad- 
vantaged populations.. 

The explanation for fewer blacks in the personal survey is probably attributa- 
ble to whefe the 25 clusters happened to fall in the city, and their homogeneity. Of 
25 clusters in Wilkinsburg, 11 contained no black respondents, while four were 
three-fourths or more black. This homogeneity of neighborhoods means that be- 
cause one happened by chance to draw starting points in just one or two extra white 
rather than black neighborhoods, the estimate is biased. This risk is present in any 
cluster sample in which the number of clusters is not very large, and is particularly 
severe when neighborhoods are homogeneous. As predicted by sampling theory, a 
random telephone sample of households drew a better estimate of the universe 
being sur yed than clustered personal interviews with the same number of 
respondents. When neighborhoods are homogeneous as they are in Wilkinsburg, 
the bias is all the greater.^® 

Comparing the results of the two surveys on all other respondent character- 
istics shows that the two methods arrived at the same estimates. Since recent 
Census data, are not available in comparable form, there is no way to judge the 
relative accuracy of the two methods on these variables. Still, it is worth noting that 
there were no statistically significant differences between the personal and tele- 

^" The home ownership question on the* surveys had a different form from that uned by the Census, 
precluding that comparison. Using the aurvey data. 29.6 percent of the telephone sample cotnpared to 
40.4 percent of the in-person survey reported owning their own homes 

Another supplemental explanation is that personal interviewers had some difficulty in gainin^r 
acce.ss to apartment buildings. When interviewers did gain admittance, they also encountered liiglu'i 
refusal twites. T^t;js there may be a differential interview completion rate in personal ititerviews that 
unde? represented blacks, and hence renters^ in Wilkinsburg. 
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phone samples in each city on responses to questions of age, education, or marital 

o status.*" ' . ^ . , . 

Turmng to variables on past political participation, where official statistics are 
availabff , we find a more mixed pattern (Table 7). Bethel Park finds identical 
estimates for both methods for the 1972 vote, a somewhat high estimate of 1975 
voting in the telephone data, and consistent underreporting in voter registration. 
In this affluent city, many voters may have registered in late October after this 
survey was conducted. The estiiriates.provided by the two methods in Wilkinsburg 
were different, and difficult to interpret in light of the differences between the 
samples regarding blacks and reviters. The 1972 voting estimates are in the same 
range, but the talephone survey seems to underreport the 1975 turnout while the 
personal-surveyuhderestimates the voter registration. 

This review of the literature and the findings from the Rand Pennsylvania 
surveys indicate that the telephone has become an accurate medium for securing 
a represents iive sample of most populations.** After including the joint effects of 
the sampling universe, simple within-household respondent selection, and refusals, 
the final telephone samples closely matched the communities surveyed and were 
af least as accurate as the personal interview sample. If there are major limits on 
the use of telephone surveys, tbey must be found in the nature and reliability of 
the questions that can be f?sked by telephone. 

« The age and education level of the growing black population in Wilkinsburg are "[elajively close 
to that of thte white population, so the racial differences found by the two survey methods doe* not 
significantly affect other demographic characteristics. „^ , . , . 

* ' To keep in perspective the findings in this section, a caveat should be offered. In one respect the 
Bethe Park Shd Wilkinsburg comparisons failed to exploit the presumed perspnal '"^.^'f^ 
for allowing detailed within-household respondent selection procedures. In this study, both the tele- 
phone and personal questionnares c.nployed the simple designated-sex approach. 
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.Table 7 



Comparison of Telephone and Personal Survey Estimates with 

Election Records 
(percent) 



Rand Survey 



Voting Activity 



Election 
Record** 



Voting in 1972 
National Election : 

Bethel Parle 

Telephone Survey 
Pertona|-8urvey 

WUkinaburg 

Telephone Surve>' 
Personal Sumy 

Voting in 1975 
Lo|C«l Elections: 

Bethel Park 

Telephone Survey 
Personal Survey 

WUkinaburg 

Telephone Survey 
Personal Survey 

1976 Voter RegUtration:^ 

BethelPark 

Telephone Survey 
Personal Survey 

WUkinaburg 

Tele^'hone Survey 
Personal Survey 



72.2 



58.0 



44.1 



33.4 



82.7 



70.9 



Estimate 



74.0 
74.0 

6b.3 
61.0 



53.5 
46.5 

33.2 
44.5 



77.7 
76.7 

74.4 
67.5 



Standard 
Error 



Difference 



±3.0 
±4.9 

±3.4 
± 5.8 



±34 
±5.4 

± 3.3 
± 5.6 



+ 2.9 
±4.4 

±3.1 
± 5.6 



1.8 
1.8 

7.3 
3.0 



9.6 
2.4 



- 0.2 
+ 11.1 



5.0 
6.0 



3.5 
3.4 



^Turnouts and registration were divided by Census projections of the total number 
of adults in eacK cit^ that year to obtain the percentages of adults who voted and 
were registered. 

''Data only available for November, after registration wu closed. Survey estimates 
are for late September. 



3. TELEPHONE SURVEY RESPONSE RELIABILITY 



The interaction among sensitive or complex questions, interviewer and respon- ^ 
dent rapport, the interview mode, and the respondent's personality all affect the 
relative reliability of telephone and personal interview response?. Responses over 
the telephone, it has been argued, are not as intrinsically reliable as those given 
in face-to-face interviews. Others maintain that personal interaction mcreases the 
tendency to give socially desirable answers. This section will first review the litera- 
ture on telephone response reliability and then will examine the comparability of 
telephone and personal responses in the Bethel Park and Wilkinsburg surveys. 

EARLY RESEARCH ON RELIABILITY 

Some 65,000 leaflets were dropped over parts of Salt Uke City in 1961 for a 
message diffusion study. After subsequent interrogation of respondents in the test 
areas, Larsen concluded that faceto-face interviews minimized prestige-motivated 
exaggeration compared to telephone interviews. However, several problems ap- 
pear in the study design, including the failure to randomly assign interviews. All 
respondents in one neighborhood were interviewed in persort, while.all of those in 
the second area were telephoned. Uter research rarely supported Larsen s 

findings.' . , 

Another of the earliest telephone and personal interview comparisons reported 
in a<«cholarly journal is Oakes' brief account in 1964 of differences in frequency of 
responses to an open-ended question. Two hundred sixteen students were can- 
vassed for suggestions for improving the university cafeteria. Peftonal interviews 
produced twice as mAny suggestions per respondent (2.80) as telephone interviews 
(1 39) Oakes believed that the inherent nature of personal interviews encouraged 
people to "express their attitudes and opinions more fully." Oakes also noted that 
a search of journals over the preceeding 12 years failed to uncover a smgle article 
contrasting the relative merits of the two survey approaches, and that a body of 
reliable evidence", was needed.' . , . • 

. Not until the 19608, however, did social science and marketing journals begin 
to publish findings of interview-method comparison studies. Cahalan surveyed new 
car owners in the New York City area regarding newspaper reading habits of the 
New York Herald Tribune. The proportion recalling having read particular news- 
papers "yesterday" in telephone interviews was. very close to that in personal 
interviews. Follow-up visits after t>ie initial telephone interview provided copies of 
recent newspapers for "aided recognition," but approximately 98 percent of the 
respondents maintained their earlier judgments.^" 

' otto N Larsen. "The Comparative Validity of Telephone and Fnce-to-Face Interviewn in the 
Mearrement of MessaMe Diffusion from Leaflets." Am.rimn M„iral Review, Vol, 17. August 19.^2. 

pp. 471-476. , ^ 1 1 * • M I 

» Ralph H Oakes. "Differences in Responsiveness in Telephone Versus Personal Interviews. Juur- 

nal of Marketitm Vol. 19. October 1954. p. 169, p. . , 

» Don Cahalan. "Measuring Newspaper Readership by Telephone; Two Comparisons with Face-t,.- 
Face Interviews." Journal of Adverfmng Renean-h. Vol. I. December 1960. pp. 1-6. 
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In 1962, Schmiedeskamp^s analysis of two University of Michigan Survey Re- 
search Center economic polls provided the first major published consideration of 
telephone and personal interviewing using a large cros^-sectional data base. Tele- 
phone respondents, however, constituted the second wave of a panel which was 
initially interviewed face*to-facb. Schmiede^kamp makes clear the findings apply 
only to telephone reinterviews And not necessarily to ''cold*' telephone surveys 
where the respondent had not been previously contacted. Econonuc and consumer 
data derived fVom the two approaches were ''very pearly equivalent'* on almost all 
items with only a few exceptions. Any patterns in the differences were difficult to 
discern. Telephone reinterview responses were not consistently more optimistic or 
more guarded than answers in person. Contrary to Oakes' early finding, telephone 
responses were not notably less verbal to open-ended and 'Vhy" questions. They^ 
were, on the other hand, slightly more inclined to opt for neutral anwersT'same", 
'"depends", ''uncertain", "as expected") over the telephone. Accompanied by the 
appropriate caveats, Schmiedeskamp's article suggested cautious optimism regard- 
ing the relative reliability of telephone surveys and hinted that any systematic 
differences in telephone tesults, given sampling comparability, are likely to be 
fairly subtle.* 

In the 1^60s many commercial researchers expanded their use of telephone 
surveys and began to use central telephoning facilities and WATS lines for less 
expensive long distance interviewing. Ifnnethodological studies were conducted as 
part of this research, it was seldom published, and the data were pi:oprietary. One 
exception was a brief note in which Assael indicated that telephone responses on 
product purchases were highly correlated with store audits of actual product sales.* 

An absence of method bias was suggested by Wheatley who conducted an 
imaginative study among 222 University of Washington students. Eleven bipolar 
scales were constructed to measure attitudes towards various brands of beer. Eech 
scal^ (smooth/rough; prestigious/ ordinary, etc.) contained nine intervals. Respon- 
dents were asked to "look at the numbers on your telephone dial; so that number 
1 would present one extreme of the scale and number 9 the other." Medn evaUiation 
scores over the telephone did not differ statistically from those made on seH^idmin* 
istered written questionnaires.* Most social scientists, however, doubted the rele- 
vance of the market research methods. Using telephones might be "cokt effective" 
for obtaining reasonable product information about shampoo and peanut butter, 
but social scientists wanted precise data on more sensitive topics. Studies on beer 
were not persuasive. \ 



RELIABILITY OF SENSITIVE QUESTIONS 

There is a small but\growing social science literature which suggests that 
telephone surveys do obtain the same results as personal surveys. Reliability has 
noW been demonstrated in highly personal areas of crime, health, and income. In 

^ Jay W. Schmiede8kamp,'6p. cit. 

• Henry Awael. ^'Comparison of Brand Share Data by Three Reporting Systems " Journal ofMurkvi- 
tn^ Reworch, Vol. 4, November 1977, pp. 400 401. 

• Jphn J. Wheatley, **Self-Adminiiitered Written Questionnaires or Telephone Interviewn?** Journul 
ofMarketinfi Hf search, Vol. 10, February 1973, pp. 94-96, 
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the area of crime, Tuchfarber and Klecka compared the findings of random-digit 
dialing telephone polling with personal interviews for crime victimization research. 
Victimization data from the two techniques were significantly different. Respon- 
dents revealed that they had been subjected to criminal activities more often 
through telephone contacts that they did in person. On the assumption that the 
approach which uncovers more crime is the better method, Tuchfarber and Klecka 
judged the telephone survey results superior.' 

Research in the health field includes impressive evidence that surveys conduct- 
ed by telephone do as well as personal interviews in obtaining highly pc-rsonal 
information. Josephson reported highly successful results in telephone screening 
individuals for visual impairment in Cleveland. Telephone c6ntacts with over 2,000 
people provided findings equivalent with 183 personal interviews, and were 
confirmed by subsequent personal interviews which found little or no over or 
under-reporting of visual probleijris by telephone.^ Hochstim contrasted the results 
obtained from two California County Health surveys. One poll obtained 977 mail 
questionnaires; 5i8 telephone, and 284 personal interviews. A second survey of 
women over age 20 completed 524 mail questionnaires, 285 telephone, and 137 
personal interviews. By and large responses w-re consistent across all three meth- 
ods. Although the health surveys included sensitive subjects, relnting to cervical 
cancer dnd pelvic examinations, Hochstim found d^ta which was "virtually inter- 
changeable" among approathes on most substantive questions." 

Although they did not conduct face-to-face interviews, other research groups 
found that very personal information could be coUectod by telephone. Mooney. 
Pollack and Corsa report that the California Department of Public Health ques- 
tioned women in Contra Costa County over the telephone regarding menstrual 
cycles, pregnancy, and illnesses and obtained very high degrees of cooperation." 
Coombs and Ffeedman recount the successful telephone reinterviews with Detroit 
area women for a longitudinal fertility study." 

These findings are further supported by two general studies that include daU 
on both telephone and personal surveys across a range of substantive questions. 
Results of telephone interviews with 85 people who had eariier been interviewed 
personally were contrasted to data from 98 personal rejnterviews. The respondents 
were New York City residents living in two community planning districts. Rogers 
concluded: 

The results indicate that the quality of data obtained by telephone is com- 
parable to that obtained by interviews in person." Respondents can and do 
answer complex items on the telephone; they reveal sources and amounts 
of income; they report years of schooling and whether they vot^d in recent 
elections.'" 

' Tuchfarber and Klecka, op. cfl.. pp. 47-63. 

" Ki ic Josephson. "Screening for Visual Impairment." Puhlir Health Reports, Vol. 80. No. 1. JanUiuy 
iy»i5. pp. 47-54. ^ ' . ^ 

" Josep^i ft- Hochstim, op. cit. 

H. William Moonev. Beatrice Pollack and I-eslie Cor«.. Jr . "^TtOephoneinterviewmK^^^ 
Studv Human Reproduction." Puhlu HvaUh RvportH. Vol. No. 12, December 1968. pp. 1()49-11)W) 

' '' Ix)laKene Coombs and Ronald Freedman, "Use of Telephone Interviews in a Lon^itudmal Fertility 
Studv." Puhlu- Opinion l)uarterly. Vol. 28 Spring 1976. pp. J 12-117. 

" Theresa R. RoRers. "Interviews by Telephone nnd in Person: Quality of Responses and Field 
Performance." Puhlh- Opinion Quarterly, Vol. 40. Spring 1976. pp.51-65. 
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Similarly, I^cander, Sudman, and Bradburn found that respqnses to increas- 
ingly threatening questions were equally distorted in telephone as they were in 
face^to-face interviews. The proportion of those incorrectly claiming no conviction 
of drunken driving, having voted ifi the primary election, not having declared 
bankruptcy, holding a library card, and being registered to vote was the same in 
both types of interviews. Checked against available records, distorted responses 
were progressively greater for the threatening questions, especially drunken driv- 
ing, but the degrees of inaccuracy for both interview methods were parallel on each 
item.'^ Telephone surveys did not avoid the problems created by threatening ques- 
tions, but there was no reason to prefer personal interviews over telephone inter- 
views. 

Personal finances may, however, be more taboo over the. telephone (and in 
person) than health and most other questions. Distinguishing between questions 
that might threaten respondents with some social embarassment and those that 
relate to their economic well-being may be necessary, since personal and family 
income questions provoke far more refusals to answer than do other questions. 
Schmiedeskamp*s telephone reinterview of an SRC national sample prompted the 
following observation: 

Telephone respondents appeared reluctant to divulge personal financial 
data. In November 1959, only 3&percent of telephone respondents admitted 
to having installment debt, compared with 43 percent of personal-contact 
responents Telephone respondents were also less frequently willing to esti- 
mate their family incomes for the current or following year. Furthermore, 
over the telephone many respondents would only supply brackets which in 
many cases had to be suggested by the interviewers*'^ 

This point is important and explains why most telephone survey research on 
income data has moved to the use of ranges of income. When the question is put 
in'bracket form, the telephone interview provides relatively comparable data (Ta- 
ble 8). Despite the reluctance of telephone respondents to specify precise financial 
figures, they were only slightly less likely to select one of several income brackets 
than were personally interviewed respondents. For surveys where ranges^lone are 
adequate, this limitation does not present a drawback. ^ 

Other research asking the respondents to report the range into which their 
income fahs have confirmed the fact that income data can be collected by telephone. 
Brunner and Brunner, although not citing hbw the telephone question was phrased, 
used five categories of income And obtained 79 percent completion rate from 
households with unlisted telephones and 85 percent from those which were listed. ' ^ 
Rogers achieved somewhat higher completion rates among New York City resi- 
dents and obtained answers to family income questions in 88 percent of the personal 
interviews and in 80 percent in telephone interviews. Although the difference was 
not statistically significant, the telephone again did less well. Rogers' panel also 
revealed that there was not actually a hard-core of people who persistently refused 
to discuss income. Only 4 percent of the sample refused both in 1972 and in 1974 

William I^ocunder, Seymour Sudman ^ind Norman Br*i(iburn» **An Invosli^'iition of ln(tM\ irw 
Method, Threat and Responne Distortion/' Journa/ of thv Anwrivan Statistical Assoviatiotu Vol. 71, No. 
354. June 197(), pp. 269-276. 

Schmiedeskamp. op. cL, p. 34. . ^ 

'* James A. Brunner and Allen G. Brunner, op. cit. 
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Tables 

Willingness to Provide Income Data bv Question Type 



0 


June 1959 


November 1959 


Financial •iiponiet 


Telephone 
Reinterviews 


' Penoiul 
Interviews 


Telephone 
Reinterviews 


Personal 
Interviews 


Supplied an estimate of 
income Expected 
during the current 
or foUoivjng year 


74% 


80% 


' 73% 


78% 


Named a dollar amount 


60 


m 


50 


61 


Supplied only an income 
bracket 


24 


7 


23 


17 


Number of casei 


(340) 


(957) 


(365) 


(963) 



SOURCE: Schmiedeskunp (1962), p. 31. 



to report their income. Seventeen percent refused on one occasion but did respond 
to the other.! • Locander and Burton tested four different techniques for agking total 
income over the telephone. Their chief concern was the effect question wording and 
various presentatiohs of seven income categories would have oa under- or over- 
reporting of income. In terms pf reducing refusals, however, it turned out that none 
of their approaches was especially effective. Completion rates ranged from 71.1 
percent to 75.9 percent." 

In a 1976 University of Michigan Survey, Research Center national telephone 
poll, 37 percent of the respondents did not supply answers to an open-ended annual 
family income question compared to 13 percent in a parallel personal interview 
survey.'.' When income wasasked in terms of three broad categories, howpyer, only 
17 percent of the SRC telephone sample did not answer. The Michigan study had 
siciilar refusal rates for items concerning spouse's income, and slightly fewer refus- 
als for open-ended and three-category questions on the respondents' incomes and 
/ size of their tax refunds. 

These SRC surveys also asked people if they felt uneasy about discussing 
particular topics on the telephone or in person. Unease regarding income questions 
over the teleph( ne surpassed all other topics with 2a percent of the respondents 
saying they were uncomfortable discussng this subject. In person, 15 percent said 
they were uneasy talking about income with the interviewer, although respondents 
may have been more reluctant to aclmit their discomfort in a face-to-face situation. 
By way of contrast, 9 percent were uneasy discussing their voting behavior over 
the telephone compared to 8 percent in person." 

Rogerg, op. cit. 

" Wilium B. I/Kander anfl John P. Burton, "Thf Effect of Question Form on Catherine Inrome Data 
by Telephone," .hmrnal of Marketinft Resean h, Vol. 13. May 1976, pp. 189-192. 

Robert M. Groves, "A Comparison of National Telephone and Personal Interview Surveys: Sonu' 
Response and Nonresponse Differences." paper presented at the 1977 meeting of the American Associa- 
tion of Public Opinion Research, p. 21. 
Ibid., p. 19. 
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The studies reviewed here support the view that the best approach to ascertain- 
ing income is througli questions that ask the respondents to choose among several 
income ranges. At the same time, they^oint up the likelihood that asking detailed 
financial questions risks high refusal rates and biased responses in personal and 
particularly in telephone surveys* ' 

A Comparison of Income Responses by Survey Method 

Using four categories of income ranges, the Rand Pennsylvania survey pi'o- 
vides further evidence that a simple income question can provide reliable data. In 
that survey, the income question achieved an 89 percent completion rate, which 
was higher than the rates reported in earlier studies.*^ Moreover, the telephone 
completion rate was as high as the. personal interview rate on, this question (Table 
9). A'review of the three factors that account for these low refusal rates helps us 
understand what influences refusals to answer income questions. 

First the income brackets were broad, simple, and few. The four categories were 
"under $10,000/' "between $10,000 and $15,000/' "between $15,000 and 
$20,000," and "over $20,000." Often social science research has little need for 
more refined categories, especially not at the sacrifice of higher refusal rates. 
Since the substantive purpose of this question for the Rand research was to aid in 
assigning respondents to general categories (high, medium, and low) of socio- 
economic status, a high completion rate was more essential to the research than 
precise income figures. 

Second, the question wording successfully grafted into the telephone interview 
part of a technique which has proven effective in personal interviews. Many face-to- 
face surveys provide respondents with a card on which income categories are 
labeled by letters so that respondents merely call out a letter to the interviewer.. 
In the Rand survey, the wording was as follows: 

We have four large categories of annual family income. A, B, C, and D. We 
would like ycu to estimate which of the following categories you and your 
immediate family would be in before taxes in* 1975 . . . 

Group A— Under $10,000 
Group B— Between $10,000 and $15,000 
Group C— Between $15,000 and $20,00 
Group D~Over $20,000 

A number of experienced telephone interviewers volunteered that although they 
usually felt uncomfortable asking financial questions, this wording removed some 
of the awkwardness. 

This point leads to the third explanation for the higher completion rate- 
interviewer attitude. As many commentaries have pointed out, the mental attitude 
and approach of interviewers is crucial. The importance of the income question was 
stressed in interviewer training as well as during subsequent monitoring of inter- 
views. If interviewers feel that a question is an invasion of privacy, tfhey can easily 
encourage refusals by a tone of voice that communicates their sense that the 
question is personal and need not be answered. In addition to noting this problem 

The reader should keep in mind that a certain proportion ofeliKible respondents Kenuini'ly do not 
have any sense of total annual family income and must legitimately, say "don't know." 
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Table 9 

Willingness to Supply 1975 Family Income Category 



Refused 

City to Say 



Greeniburg 6.4% 

Johnitown 6.4 

McKeeiport 8.8 

Plttiburgh 7.0 

WUliumport 6.2 
Bethel Park: 

"N,^ Telephone Survey 9.3 

Personal Survey 6.6 
Wilkinaburg: . 

Telephone Survey 5.5 

Personal Survey 8.6 



Don't 


Chose 


Sample 


Know 


Income RanRe 


Size 


3.4% 


90.2% 


(200) 


3.7 


90.9 


(514) 


5.0 


86.2 


(502) 


4.2 


\ .88.8 


(401) 


3.5 


90.3 


(402) 


3.3 


87.4 


(216) 


1.5 


92.0 


(200) 


3.5 


91.0 


(199) 


4.0 


87.5 


(200) 



in training, we placed the question at the very end of the interview. By this po^nt, 
most interviewers had established a business-like yet personal rapport that con- 
tinued through the income question. . i u 

Having a fairly complete date set as a result of these steps, we can then ask how 
closely the telephone and personal surveys in the seven cities represented actual 
city median incomes. Inflation and the absence of c^rrent city-by-city mcome date 
required projections based on economic trend^.»• The extent to which median 
family income in the telephone and personal interview surveys approximated the 
projected medians in each city is reported in Table 10. 

We should emphasize that these estimates of population income are a severe 
test of telephone surveys. They test the accuracy of telephone interviewmg at a 
point where traditional views would have us expect telephone date to be the most 
unreliable The final survey estimate on any question is shaped by the joint effects 
of sampling procedures, refusal rates, and response reliability. Thus, we can exam- 
me the cumulative effect as it relates to three importent criticisms of telephone 
interviewing: telephone survey samples underestimate low income populations; 
refusal rates further bias the sample; and telephone respondente will not provide 
answers to sensitive questions-particularly income questions-over the tele- 
' phone. If these criticisms have any validity, it should be apparent here. But the 

- Reasonable projections of the population medians ^^ere possible berause »"X"^!;;;r 
since I960 more closely matched national personal income per capita than has P«""»y'^""'*'J"J^^ ^ 
Tr capita f^rinal income in Pennsylvania was 102.1 percent that of the United States as a whoK. n 
Ko the fiSJirXas 100.1 percent, and the 1975 estimate was 100.7 percent. StaUstual AlM .f he 
S Sr^s 5976. p. 402. Furthermore, the per capita income ratios of the c.t.e« under study to tlu 
s a ^of Pennsylvania held constant during the early 1970s with the exception of WilkmsburK. 19<J 
?oTulation and 1972 Per Capita Income Estimates for Counties Incorporated Place*, and SeU-cted 
Er Svil Divisions in Pennsylvania." Current PopuluHon ^^P'-'^^^^l^l^^^^^^^^^ 
Projection., Series P.25. No. 583 U.S. Department orCommerce. Bureau of the J^.*^;,^^ "^^^ 

o PonnsvWania percapita personal income in 1969and 1972. i;^;P^,^/';*^'-):- ^''^[^.f ^j^.^^f 
f:rw.n«h iri? 106 1 08 Johnstown .80. .79; McKeesport. 91, .92; Pittsburgh, l.(K), .97 WilkinsDurK. .»w 
18 and Will am^^^^^ 86 sT) C^'ven the stability of these- relationships the ratio of the c.ty-to-nat w.nal 
L diUj'fam'ily rZe in the 1970 Census ($9,590, was used to pro>ct 1975 -;dia^ family ^ 
each citv from the 1975 estimated national median family income iiU\.im. The .sampk munaiis loi 
each of kcTven Pennsylvania cities were estimated by interpolation of the grouped data. 
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Table 10 

Comparisons of Telephone and Personal Survey Estimates 
OF 1975 Median Annual Family Income. 



City 


Rand Survey 
Estimates 


Census 
Projections* 


Difference 


Telephone Survey. 
Oreeniburg 
Johnitown 
McKeeiport 
PitUburgh 
Williatn^port 


. $14,120 
12,735 
12,591 
13,096 
12,402 


$13,445 
11,524 
12,210 
12,621 
11,798 


+ $ 675 
+ 1,211 
+ 381 
+ 475 
+ 604 


Bethel Park : 

Telephone Survey 
Personal Survey 

Wilkiniburg: 

Telephone Survey 
Personal Siirvey 


18,735 
■ 17,313 

12,500 
11,221 ' 


18,932 
. 13,170 


197 
' - 1,619 

- ' 670 

- 1,949 

/ f. 


'The 1975 eitimatei are based on multiplying the 1975 U.S. median 



family income of $13,719 by the following: Greensburg, .98; johnitown, 
.84; McKeeiport, .8«f; Pittsburgh, .92; Williamiport, .86;Bethel Park, 1.38; 
Wilkiniburg, .96 Theie are the ratioi of the 1969 median family incdme 
for each dty to the 1969 U.S. median. 



telephone survey data are remakably close to the Census-based projections. Income 
data elicited on the telephone are within $700 of the Census-projected median 
family incomes in every, city except Johnstown where the difference was $1,211. 
The telephone samples* reported income was slightly higher than projections in five 
cities and was slightly lower in two others. 

Comparing the telephone and personal survey data in 'i'abl^ 10, we find that the 
telephone data provide better estimates. Both personal survey estimates are fur- 
ther from the projected medians than , the worst telephone survey estimate. If the 
median income projections are roughly accurate, the su^-veys offer no evidence that* 
personal interview estimates of income are preferabl? to those obtained using tho 
telephone. The comparative effects of more extensive financial probing await fur- 
ther tests and cannot be addressed with the Pennsylvania data. The review of prior 
research findings and the implications of the Rand survey suggest tTiat detailed 
financial status questions may be one area where skepticism about the use of 
telephone interviewing is justified. However, it is clear that reliable data about 
family income can be obtained in broad terms over the telephone,. 

SOCIAL DESIRABILITY IN SURVEY R^PONSES 

A concern for bias due to social desirability of answers to survey questions 
reverses the burden placed on the two survey methods. Thus far we have been 
ex|3loring the criticism that telephone surveys lead to nonresponse bias and other 
distortions on income questions. A concern regarding personal interviews is that 
personal presence, eye-to-eye contact, and "rapport" lead respondents to want to . 
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appear in a more favorkble light and to select answers that are more socially 

^'"''Avlnable reseach gives only limited support for this criticism of personal inter-- 
views. Some studies find no differences. Wiseman compared responses given to 
identical telephone, personal, and mail questionnaires admm.steredto adults ma 
uburb of Boston. There was little difference in the personal and tele^one answers 
to the eleven public issue questions, The only significant differences re a ted to the 
man questionnaire which, on t^o items, found more "socially undesirable opini ns 
in favor of legalizing abortiofn and promoting birth control among unmarried 
people." Support for the equivalency of telephone and personal interviews also 
came from Colombotos' reports of two surveys of physicians concerning sensitive 
personal and professional questions. Colombotos was espec.a ly interested in any 
tendencies toward socially desirable responses in personal interviews. The larger 
survey analyzed 408 personal and 340 telephone interviews and the two methods 
produced very similar results. The smaller of the two surveys which compared 68 
^rsonal with 60 telephone interviews, found only minor differences in personal 
interview responses in the direction of social acceptability." Even though the 
surveys focused on such topics as altruistic versus monetary professional mo U va- 
tions. controversial medical practices, and devoutness ^^^'f 
botos concluded that "data from two surveys of physicians «how that here a^ 
essentially no differences in the proportions who give socially acceptable responses 
according to 'vhether they are interviewed in person or by telephone. 

On the other hand, some studies have found differences in telephone and per- 
sonal responses to certain questions in the direction of more socially ^^^n^J^^^Uve 
answers in the face-to-face interviews. Although most of the items in Hochstim s 
surveys Produced comparable answers, women were .sked about their consump- 
tion of alcoholic beverages and many more said they never drank at all when 
interviewed in person than in telephone interviews or mail questionnaires. 

Roger, contrasted city election records with reported voting among low mcome 
New York City respondents." Personal interview overreporting was greater than 
in telephone interviews. Rogers used New York voting records to validate her 
findings, and found a tendency to give socially desirable answers was associated 
with interviewer style ("warn." and friendly versus 'cool- task or.ented and bus.- 
nesslike) as well as interview mode. This finding suggests differences in soc.al 
desirability effects may come from a reduced propensity of most telephone mter- 
viewers to try to become "warm" as opposed to "inherent" differences between 
personal presence and telephone commurvication. In either event, at least some 
research indicates that the social involvement of face-to face mterv.ews may slight- 
ly skew the responses for certain questions toward more ' respectable answe.s 

Comparative Responses to Political Attentiveness Questions 

To focus on comparative responses rather than differences attfibvitable to san. 



Join. C^cionihctos. 'IVrson^l Versus IVU'phon. hU.rvi.w.s: Klhrl c K.spons.s. i uMn HmW// 
UvpnrtH. Vol. H4. No. 9, Sopti'mhur 1969. pf). 7^M-7M2. 
Ibui.. p. 7H2. • ^ ' 

ilorlistini. op. l it. 
Ko^itTH. i)i>. ( it. 



pling, subsequent analysis of the Wnkinsburg personal and telephone samples 
excludes black respondents." Respondents in Bethel Park and Wijkinsburg were 
asked about a number of matters which involve their news attentiveness and 
civic-mindednete. Good citizenship is strongly associated with community partici- 
pation, voting, and following the news. This norm pulls respondents in the dire^ion . ^ 
of overreporting such activities. For example, it was noted earlier that voting in 
prior elections is consistently overreported. Several- questions from the Pennsyl- 
vania survey allow a test whether respondents give more civic-minded, sp^mlly c 
desirable answers in personal interviews than over- the' telephone. ( 

Table 11 presents the levels of chi sqilare significance for differences in the 
responses to personal and telephone interviews for 16 political, organizational, and 
media questions. There were no difTeretices of consequence on any of the political 
behavior or group affiliation questions. Under botH kinds of interviews, respon- 
dents were equally likely to have strong party identification, to recaH having voted ^ 
in past elections, to admit having voted for McGovern.or Nixon, to say thpy had 
registered or had made up their mind in tho ^976 election, and to assert they were 
active members of at least one Icfcal organization. ^ • 

The major differences in reported behavior came in two media questions. There 
were no significant differences in Wilkinsburg, but in Bethel Park the re^ndents ^ 
interviewed in person were more likely to say they regularly followed th^B^tws. 
Y^hile 27.8 percent of the telephone respondents were prepa reef to say they never* ^ 
watched national television news, only 15.5 percent of the personal jptcf views 
contained that response. Also, half (50.5 percent) of the people interviewed face-t<^ 
face claimed they watched local television news every day compared tt) one-third 
(34.4 percent) of those interviewed by telephone. 

Overall, these results indicate that the two survey methods produced extremely 
similar responses. Sometimes telephone ^jp^rvjewing may lead to slight reductions 
in socially desirable and presumably m6te distorted answers, as in t^he case of the 
news viewing questions. Any consistent diffe'rcfntikl effect due to social ^lesirability 
is fairly subtle, however, and does not emerge on most items. Evidence from this 
and earlier studies on socially desirable responses suggests that this particular 
advantage of tejufphone interviewing is Irkely to be a very small one. 

'\ 

QUESTION STRUCTURE AND PACING EFFECTS 

The preceding discussion has concluded that the telephone survey holds no 
substantial disadvantage in asking basic income data in categorical format and 
seldom has much advantage in reducing social desirability. Additianal evidence of 
the general comparability of telephone and personal interview responses comes 
from a variety of questions in the Rand Pennsyl^n^ia survey which wefe of a 
straightforward and essentially factual nature. 

Table 12' includes the telephone and personal response comparison for 12 ques- 
tions asked in both Bethel Park and Wilkinsburg. All of these questions were ^ 
succinct and primarily fac^ial. There were no significant differences in responses 
elicited by the two methods in either city. To the extent some of these^^ues^ion^ 

" The p-eattT numlwr of blacks in the Wilkinsburg telephone sample wtis the only siKnifuiinl 
difference between the telephone and personal surveys in either city. 

• \ 
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Table 1^' 

Telephone and Personal Response Differences: 



• Politics, Median, and Organizati^ons 


— ' — 


— 

• 


. Chi Squaio Significance 


Interview 
Qu'estidn 


I 

Subject* 


Bethel Park 

A^>^va«^s m vsa •% 


Wilkinsburg 


31 


Short party identification 
.(Democratic, RepubKcan, 
• Independent) 3 


N.S. 


N.S. 


31-33 ' 


Jx>ng party identification ^ 
(strong Democratic, 
strong Republican) 


c 

■r 

N.S. 


■ N.S. 


42 


Voted in 1972? 


N.S. 


N.S. 


- 42a 


Nixon or McGovern? 


N.S. 


N.S. 


' 44 


Registered in 1976? 


N.S. ■ 


.N.S. 


45 


Ford or Carter? * 


N.S. 


N.S. 


46 


II eiecuon neiQ vuaciy, 


N.S. 


N.S. 


43 , 


Recall voting in local 
pWtifm ifi 1975? 


N.S. 


N.S. 


22 


J Frequency of discussing 
TUthpl PflrkAVilkinsburfl 
politics 


N.S. 


■N.S. 


26 


Frequency of discussmg 
national politics 


\ 

N.S. 


N.S. 


47 


Frequency of discussing 
Carter and Ford politics 


N.S. 


N.S. 


27 


Active member of group 


N.S.' 


N.S. 


28 


Number of active member- 
ships ' 


N.S. 


N.S. 


5 


National TV news viewing 
frequency 


.05 


N.S. 


6 


Local TV news viewing 
frequency 


,01 


N.S. 


1,0 


Newspaper reading frequency 


N.S. 


N.S^ 



V 



*$ee Appendix B for full question wording. 



such as respondent's education, might also lend themselves to suggest more socially 
desirable responses, they provide further support for the absence of strong diiTeren- 
tial effects associated with that factor. 

These results also confirm a point which is rarely disputed: Simple factual 
information can be obtained using telephone interviews and the results are compar- 
able to'tho^e gained in person. In fact, the data in Tables 11 and 12 constitute 
support for this same proposition extended to the subject of income, political and 
communications activities, despite varying degrees of sensitivity. 

In contrast to this general pattern, systematic differences did emerge in one 
area which could not be easily attributed to subject sensitivity or socially desirable 
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Tabfe 12 ^ . • 

IhjTERViEW Mode Differences in Respondent Characteristics 



HI vvr viv w 




Chi Square Significance 


Question 


Subject 


Bethel Park 


Wilkinsburg 


3 


Teltvision ownership 


N.S. 


N.S. 


«^ 

n 


v/aD16 t616Vl8lOn SuUSCnpilOn 




11 .o. 


7 

\8 


Watch early or late local TV news 


N.S. 


N.S. 


Preferred local TV news station 


N.S. 


N.S. ' 


4,6. 

52 "^x^ 


Respondent's age (in decades) 


N.S. 


N.S. 


Occupation of head of household 


N.S. 


N.S. 


54 \ 


Education of respondent 


N.S. 


N.S. 


5^ 


\ Respondent's marital status 


N.S. 


N.S. 


57 


I^umber of children in household 


• RS. 


N.S. 


58 


Number of adults in b jsehold 


N.S. 


N.S. 


59 


Respondent's role in household 
(e.g., son, mother-in-law, etc.) 


N.S. 


N.S. 


60 


Annual family income 


N.S. 


N.S. 



responses. The Pennsylvania data included a series of questions on citizen attitudes 
towards their obligation to be informed. Respon(j[^nt8 were asked to say if they 
strongly agreed, somewhat agreed, somewhat disagreed, or strongly disagreed 
with five statements. One question was a standard political efficacy measure, and 
the other four were paired items, two positive, and two negative, seeking to mea- 
sure ol^ligations and pressures to follow news. Two of these statements produced 
divergent telephone and personal responses in Bethel Park. Four of the statements 
produced inconsistent responses in Wilkinsburg, including two at the .01 level. 
These differences demanded some explanation, but their nature, direction, and 
inconsistency could not be accounted for by question sensitivity or social desirabili- 
ty. ; . 

One explanation was found in the information gathered in debriefing the inter- 
viewers who conducted the survey. Ten people who had conducted telephone inter- 
views and ten who had done personal interviews were asked whether any part3 of 
the instrument proved difficult to administer and confused the respondents. None 
of those who had interviewed face-to-face mentioned the agree-disagr^^e series, 
while eight of the ten who had interviewed by telephone mentioned that series of 
.statf^ments as troublesome. During the monitoring of tb<» telephone interviewervS 
at x\v} centra] WATS facility, it also became apparent that the st.^ tender, ts the 
i'./T-fold ttv-iponse categories were more* awkward '^San other questions. 

ini3{*6rtion of the tables suggested that in sev/iral instances the distinctions, 
appeared to ♦';rt*:'rge from the distribution of "stiongly and "sotnewhat" ref^ponst^B 
rather than bet\ve(.:i "agree'' and ''disagree''. For exrtmple, Wilkinsbur g opinions 
on one stater/ient are shf>wn in Table 13. When the ic^sponses an^ collapsed thm 
the two agree categories are combined and the two disagree categories are com 
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Table 13 



My Friends Pay a Lot op Attention to the News 

(percent) 



Wllkinsburg 


■1 

atron^y 
Agre« 


Somewhat 
Agnw 


Don't * 
Know 


Somewhat 
Disagree 


• Strongly 
DUagree 


(n) 


Ptnoiud 

' Telephone 


\<6.1 
36.6 


28.6 . 
° 44.3 


7.8 
, 3.1 


11.0 

la.b 


6.6 
3.1 


(164) 
(131) 



Chi aquar* aignifictuice ■ .025 



binetUhferc i" no significant difference in the likelihood of personal or telephone 
respondents to agree with the statement. Table 14 presents the merged columns. 
If the categories of all the agree^sagree statements are collapsed as they Were in. 
Table 14, most of the differences disapoear. Of 10 comparispns (contrasting tele- 
phony and personal interviews for each of five statements in two cities), 3 rather 
than V are still statistically significant and only one at the .01 level.- 

Table 14 

Collapsed: My Friends Pay a Lot of Attention to the News 

(percent) , . 



1 

Wilkinaburg 


(CoUapaad) 
Agree 


Don't 
Know 


(CoUapaed) 
Disagree 


•5 

(n) 


Penonal 


74.7 


7.8 


17.6 


(164) 


Telephone 


80.9 


3.1 


16.0 ■ 


(131) 



Chi square ligniflcance * .194 



ERIC 



Another set of differences between the personal and telephone surveys not 
expteinable by question sensitivity or social desirability was found for a series of 
knowlfcige questions. Jileven questions were designed to tap the respondent's abili- 
ty to idStifv public officials at the national, state, and local levels. There were no 
statisticaUy asjjTufiamttlifferences between the success of Wilkinsburg telephone or 
personal interview respondents in correctly naming incumbents. In Bethel Park, 
however, personal interview answers consistently si'.rpassed telephone responses 
in ibii proportion of acciirate identifications. In four instances (city council, school 
superintendent. Secretary of b^, U.S. Representative), the differences were sig- 
nificant at last at the .05 or .01 level. Two others (local police chief and Pittsburgh 
police chieO were significant at the .10 level, and the differences in the remaining 
five were all the same direction with personal interview answers scoring higher. 
TaEIoTrshows the proportion of correct identification for each office by interview 

mode and city type. 

A possible explanation for the superiority of personal interview responses in 
Bethel Park is the leisurely pace at which those interviews were conducted. Table 

4i ■ 
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Table 15 

Respondent Identification of Public Officials by Interview Mode 

(percent) 



Interview 
Question 


10, 




Bethel Park 






Wil kinihurfl 

ww as na sav s * wsa k 




Office 


Personal 


Telephone 




Difference 




Penonai 


Telephone 


Difference 


12 


Mayor " 


76.5 


74.9 


+ 1.6 


40.3 


34.1 


+ 6.2 • 


13 


C!mincil 


44.5 


30.2 


+ 14.3* 


27.9 


19.7 


+ 8.2 


14 


Police 
















Chief 


44.0 


34.9 


+ 9.1 


13.6 


13.6 


0 


15 


Superin- 
















tendent 


35.5 


24.7 


f 10.8^ 


18.8 


15.2 




16a 


PitUburgh 












♦^3.6 




Mayor 


95.5 


92.6 ' 


+ 2^9 


92.9 


93.2 


-b.3 


15b 


Pittsburgh 
Police 
















Chief 


40.0 


30.7 


+ 9.3 


26.6 


32.6 


- 6)0 


16 


Governor 


94.5 


91.6 


+ 2.9 


90.3 


81.8 


+ 8.5 


17 


Lt. Oov- 
















emojr 


47.0 


43.7 


+ 3.3 


34.4 


38.6 


- 4.2 


18 


U.S. Qhief 
















Justice 


26.5 


23.3 


+ 3.2 


22.7 


19.7 


+ 3.0 


19 


Secretary 
















of SUte 


83.5 


69.3 


+ 14.2* 


66.2 


62.1 


+ 0.1 


20 


U.S. Repre* 
















sentative ' 


50.5 


37.7 • 


+ 12.8* 


25.3 


28.0 


- 2.7 



•.01. 
*>.05. 



16 reports interview times for Bethel Park and Wilkinsburg telephone and personal 
interviews. The fnedian telephone interview in Bethel Park took 14 minutes, while 
the median personal interview was 26 minutes. In Wilkinsburg, on the other hand, 
the median length of both the persbnal and the telephone intetrviews was 15 
minutes. * 

Slower-paced Bethel Park personal interviews may have allowed respondents 
more time to reflect on the correct answers to the political knowledge questions. On 
the telephone, monitoring found the pace of asking the knowledge questions to be 
a brisk one and, if respondents did not immediately know the identity of a particu- * 
lar office-holder, the telephone interviewers jnoved on to the nex question. Similar- 
ly, the faster pace of the telephone interview may have inhibited respondents from 
aoking for repetitions of the more complex agree-disagree statements and may 
have discouraged longer deliberations on their response. Groves in his account of 
the University of Michigan Survey Research Center's telephone and personal inter- 
view comparison surveys, has also obseryed "the tendency toward faster-paced 
interviews'' ovor the telephone." 

The possibility of pacing effects raises two important issues. First, it suggests 
that personal interviewing may contain a differential bias caused by a relationship 
between social class and mor6 leisurely paced interviews. If interviewers spends 

Groves, op. cit., p, 3. \ 
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Table 16 

Length of Personal and Telephone Interviews, by City 



Lsngth of Interview 
in Minute* 



9-10 
11-12 
13-U 

16- 16 

17- 19 
20-24 
26-29 
80-34 
36-39 
40-66 
66 + 



Bethel' Park 
Telephone Penonal 



City 



0.5% 

2.0 

2.6 
11.0 

2.5 
24.0 
22.0 
30.0 * 

4.0 

1.6 



100.0% ' 100.0% 



9.8% 

20.0 

24.6 

23.7 

15.4 
6.1 
1.6 



WUkinsburg 
Telephone Penonal 



6.0% 
16.6 
23.4 
18.6 
14.6 
16.5 

3.6 

0.6 

0.6 
100.0% 



4.6% 

2.6 
13.0 
36.6 

8.6 
21.6 

7.9 

3.5 

0.6 

2.0 

0.5 

100.0% 



more time in pleasant and affluent homes and neighborhoods like those in Bethel 
Park, then the p^ce of the interview may affect the nature of responses and lead 
some responden a in Wh homes to appear more knowledgeable and give more 
aecially desirable responses. If this differential bias is generally present, it would 
pbsft problems in interpreting findings about social class based on personal survey 

data. • • • ... 

Second, the faster pace of telephone interviews* indicates that questions which 
may necessitate more deliberation by many respondents should be approached 
with great care. Certainly any question cplling on the respondent to reflect should 
be emphasized in interview training, and interviewers should be taught to be 
conscfous of the pressure the telephone interview places on the respondent to give 
a quick answer. But, more generally, the typically rapid pace of telephone inter- 
•/i' compounds difficulties associated with complex survey questions and con- 
b .IS the type of questions that can be asked. Thus, there appears to be a serious 
problem with adapting to the telephone certain kinds of intricate scales, projective 
statements, and similarly involved items." One can monitor comprehension of 
questions at the central WATS facility, and if very many respondents cannot under- 
stand an item the first time it is read and request that it be repeated, then there 
are likely to be problems in the reliability of ans.wers to that question. 



QUESTL W STRUCTURE NOT SUBJECTS 

This review of the reliability of telephone survey data suggests that concern 
with response bias to sensitive questions can be redirected to cnncern with question 
complexity and pacing effects. With the notable exception of extensive financial 
probing, there were no areas where respondent sensitivity prompted any more 



Also see Crovea' comparison of telephone and personal responses on scales, op. oil. 
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nonresponses or significantly differentj responses over the telephone than were 
obtained in personal interviews. Respondents provided comparable answers to'^ 
questions about political attitudes and behavi(^r, interpersonal relationships, com- 
munications and media involvement, ccmmunity activity, health status, criminal 
victimization, persopal demographics, s nd in broad terms, income, / 

The propensity of some respondent! i ta give more socially acceptable answers 
affects all interview modes. Telephone and personal interview responses ire likely 
to be similar even on most questions involving alternatives that are quite socially ' 
desirable. Occasionally, however, prior research and Rand's Pennsylvania survey 
encountered modest differences which di d appear to be associated with social desir- 
ability and the tendency to give m'^^^e cjvic-minded replies in pei:i<onal interviews. 
To the extent this patterfi may sometjmes emerge, it represc^nts an advantage 
accruing to telephone interviews. ! / 

Instead of stressing issues of subject matter (aside from financial data) and 
relative social desirability, tbie an^dysis has suggested' that greater attention 
should be directed toward the structure and difficulty of the questions asked, alpng 
with the speed and pacing of the interview. Although experience has taught the 
merits of unambigubus, straightiorward, and simple survey questions, social scien- 
tists sometimes feel they mu^t use complex, lengthy constructions with multiple 
alternative response categories. Findings reported here demonstrate that there is 
justifiable skepticism regaming the adoption of intricate items for the telephone 
survey use, and indicate that further research is n^ed on this issue. 

Analysis of the Rand Pennsylvania study has also raised the possibility of 
differences in telephone and personal survey responses related to the speed and 
pacing of the interviews. The telephone interview pace may be tfn inherent con- 
straint on the manner in which certain kinds of questions can be asked. On the 
other hand, the tliflficulties created by the tendency of telephone interviews to be 
faster paced may be subject to correction through the proper use of probes and 
interviewer, training. Again, attention of methodological studies might usefully be 
directed .to the structure and pacing of questions. 
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4; QUALITY IMPLICATIONS OF SURVEY 
ADMINISTRATION 



Telephone surveys uftder most circumstances provide representative samples 
and reliable responses, but there remains another set of important issues related 
to the interview as a whole and the management of its administration. Here we find 
one limitation, and a pumber of significant advantages. 

The limitation is simply'that one cannot easily design a telephone survey that 
approaches the length of personal interviews, To be sure, there a few examples of 
extraordiharily long telephone interviews which are said to have been successful. 
Rogers reports that her telephone reinterviews with respondents who had previ- 
ously been interviewed in person lasted 50 minutes.' Elite interviews on the tele- 
phone have gofle as long as an.hour.« Nevertheless/most telephone interviewsare 
limited to periods of much shorter^duration. 

^ A poll of academic survey research organizations with experience conducting 
telephone interviews found some groups estimating the maximum feasible length 
of a telephone interview as 8 to 10 minutes, while others said the maximum feasible ^ 
time was 45. 60. and 75 minutes. The median estimate of the maximum length was 
30 minutes. And in actual practice, typical telephone interviews were designed to 
last between 10 and 20 minutes.' 

Our own experience leads us to concur that this range is optimum. Monitoring 
of the Pennsylvania survey oOen revealed signs of restlessness and fatigue among 
respondents as the interview wore on even though the median length was only 15 
minutTs. and few Weeded 20 minutes. As Groves also noted, respondents increas- 
ingly asked "about how much longer the interview would last."" Throughout the 
interview there was a small but steady attrition. Every additional mmute more 
respondents unilaterally terminated the interview. By the end of the interview, 
' four percent of those who had begun answering quetions had broken off the inter- 
view Analysis of the incomplete interviews revealed that these terminations tend- 
ed to concentrate around each transition point. Each time the interview would sh.a 
from one set of questions to another, some respondents would break off. This 
breakoff rate is consistent with rates reported elsewhere, but we do not know if the 
attrition is simply a linear function of time, or whether it would rise dramatically 
for very long interviews. Surveys cited elswhere suggest that breakoff rates ol 
initially cooperative respondents range from one to four percent, but that experi- 
ence is also for reasonably short interviews.^' It would be useful to have additional 
documentation on the damage from breakoffs and fatigue in longer telephone 

steps can be taken to circumvent this problem of a time limitation. Social 

' KotcerB. op. cit. 

» ColombolQB. op. cit.' 

. ""InterviewinR in Telephone Surveys." Survey Hesearvh January 6. 197.5. pp. H l.J. 

' Bnmkofl"ratrM f ron. 8i-veral'«tudii-« are cited in Don Dillnian. Juan (Irolon Gall eKox." and Jan„-s II. 
Frev op cirB Jeakoff rat^^^^^^^^^ interview« are non-existent or neKl.hle. but .t .« not «o clear that 

tiici e are not significant fatiffue efTects in personal interViewinK. 
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scientists with an extensive research agenda to put into a questionnare should 
examine the possibility of split halves of the sample so that some lower priority 
questions could be divided between two forms of the questionnaire. Large sample 
sizes coupled with random sampling procedures would nlake it possible to divide 
the questions even further into multiple forms. If the questionnaire is still a long 
one, however, the telephone looses much of its appeal as a medium for data collec- 
tion. 



FLEXIBILITY AND QUALITY CONTROL 

Other features of telephone surveys provide opportunities for flexible manage- 
ment and quality control superior to those found in the administration of personal 
surveys. It is very important to recognize that social scientists have unique oppor- 
tunities to improve and maintain quality with telephone interviewing by being able 
to remove some interviewer obtrusiveness, to improve question administration, 
and to monitor interviewer performance. In each respect, social scientists can 
improve data quality in ways that are generally beyond reach with personal inter- 
views. 

Minimizing Interviewer Obtrusiveness and Bias 

In telephone interviewing, the absence of visual contact has valuable side , 
benefits: The respondent cannot see the interviewer's appearance and manneristns 
which might intrude. Interviewer race, social class, sex, and other characteristics 
which can interact with respondent attitudes are minimized.* Likewise, respon- 
dents are not distracted by seeing their answers being recorded on the question- 
naire. . . 

Wheh telephone calls are assigned randomly, what interviewer bias that does 
exist is distributed in ways that will not affect the analysis. Bias related to tele- 
phone interviewers (respondent reactions to their voice and tone, interviewer ques- 
tion reading, and coding ideosyncracies) is distributed randomly. Estimates of 
population characteristics would of course be affected but each bias would not be 
compounded with particular clusters and types of respondents as they would be in 
personal interviews. 

Another source of interviewer bias that is minimized by telephoning is the 
advantage of not being exposed to physical risk. When the interviewer can call 
rather than visit high crime areas, it eliminates worry about the safety of the 
interviewers. That capability removes a pressure on the interviewers that might 
lower completion rates in such neighborhoods. 

Question Administration and Monitoring 

Alterations in the questions and the conduct of the survey are facilitated in 
telephone interviewing. Even the best-planned pretests do not always uncover all 

* Stanley L Payne. '*Some AdvantageB of Telephone Rurvey«," Journo/ of Marketing, Vol *Ml 
January 1956, pp. 278^281; on the Reneral problem of interviewer efTeeLn, »ee also Barbara Snell Dohreti- 
wend. John Colombotos, and Bruce P. Dohrenwrnd, "Social Dintance and Interview KfTecU/' hihlir 
Opinion (^uarff r/v, Vol. 32, F*all 1968» pp. 410-422; Howard Schuman and Jean M. Converm*, 'The Kffects 
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the problems with a new inBtrument. Working at a central telephone facility, the 
researcher can listen in to calls to hear how well the questions on the final instru- 
ment are obtaining the content they were designed to top. This ability to actually 
hear interviews can also greatly enhance the researcher's intuitive grasp of the . 

survey content.' , . • * • 

Monitoring also identifies weak interviewers and areas where interviewer 
training may have been inadequate: On the secondday of the Pennsylvania survey, 
minitors discovered that two of the telephone interviewers had misundersto^ the 
intended use of probes in four questions. They were failing to probe as indicated 
in two questions, but making too many probes for two questions later in the inter- 
view Had they continued unchecked, certoin answers would have been inflated, 
but the error could not have been discovered from the marginals. Monitonng 
• permitted an immediate correction. AddiUpnally, »ince other interviewers alsp 
lAight have misinterpreted those particular instructions, the supervisor was able 
to carefully reiterate and emphasiie them for all interviewers. 

Another iUusti-aUon of the flexibility of central telephone interviewing, and ito 
problem-solving advantages, occurred two weeks into the Pennsylvania survey 
One of the survey questions asked respondents the name of the city police chief. 
Inmid-September, the police chief of Johnstown resigned. In the field, interviewers 
on their own would not know how to cope with the coding of responses identify ing 
the newly appofnted chief With centi^lized telephoning, however, it was possible 
to learn about and deal with the change immediately. The telephone supervisor was 
able to quickly devise a new set of categories and provide copies to all interviewers. 
The revised answers included categories- indicating whether the respondents did 
not know of the change; knew the (fhange, but did not yet know the name of the 
new police chief; or knew the name of the new chief A problem that might have 
token several days to solve in a personal survey was handled within the hour and 
provided instead a useftil variable measuring diffusion of information. 

Other advantages of tiie centraliied management of telephone surveys relate 
directly or indirectiy to the final sample. The first and most obvious benefit is that 
quotas for screening questions and within-household selection procedures can be 
closely monitored. If the selection grid is producing a distorted sample, procedures 
and quotas may be quicky refined. With personal interviews, flexibility is limited 
both by the lag time between actual interviews and their being collated at a central 
point and by the difficulty of communicating changes to all of the dispersed staff 
of interviewers. Unlike central WATS interviewing, it is much harder to detect a 
poor question, a poor interviewer, or failure in the quote selection system. 

Another special asset bf telephone sampling is ite random distribution of calls. 
One of the unique advantoges this brings is the opportunity to view ^he survey as 
constitoting a succession of random sample surveys. To use the sample in this way 
requires that care must be token in two respecte. First, one must sustain the same 
rates of sampling in all areas so that calls in each city, neighborhood, and telephone 



ofBlack and White Interviewem on Black Reaponie. in 1968." I'uhlir Opinion Quarterly Vol 35>prmK 
?971 pp. 44^rwmia J. Goudy and Harry R. Potter, "Interviewer Rapport: Dcm.He ( a ( onc.pt. Puhlu- 
Opimon Quarterly, Vol. 39. Winter. 1976-76. pp. 5'29.543. 

' Interpretation of what is mandatory in enBuring respondent privacy and ""°">;;"fyjYrflr,m 
example. California state law prohibit. listen.nK to the respondents! sule of he 7";.^ 
in that jurisdiction can'monitor only the interviewer, In other areas, it is le^al to Imten to th*- entire 
interview. / 
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exchange are completed at the same rate. Second, one must exhaust all callbacks 
for a set of calls, and not let them drag out through subsequent periods. In the Rand 
Pennsylvania ^tudy, interviewing in all seven cities was paced together so that the 
final sample would be evenly distributed across all cities during each week of the 
survey, dividing the sample into three ten-day periods therefore results in three 
independent random aamples of respondents for each period. By way of illustration 
of the close similarity of the samples obtained in the three periods, the proportion 
of black responclents for each period was 9.7, 8.3, and 10.1 percent respectively. 

Taking steps to insure comparability of time*based samples allows one to ex* 
plore interesting substantive issues, and to provide a valuable methodological tool 
in evaluating the impact of unanticipated events occuring during a survey. If, for 
example, a survey is being conducted over the course of month prior to an election, 
each week's random sample can be analyzed for trends during the campaign. In the 
event that a crisis suddenly emerges while a survey is in the field, the social 
scientist must face the challenge that any findings are an artifact of that crisis. For 
example, a finding that the public has an unexpected level of concern for environ- 
mental questions could be attributed to a temporary interest caused by a dramatic 
oil-spell. By comparing data coUectd before and afler the oil-spill, this alternative 
explanation could be addressed directly. These features could be built into the 
design of personal surveys, but only with difficulty. Establishing parallel pacing 
within clusters would be much more difficult and that constraint would increase 
survey costs. As a practical matter, one would probably achieve this end by inter- 
viewing independent probability samples of clusters in sequential waves. Lag times 
in knowing day-to-day completion rates by cluster would make the process awk- 
ward to manage and each wave would have larger sampling error due to the cluster 
structure. 



COST 

Despite its importance, we have held a discussion of the cost factor until last 
because the emphasis on co3t has tended to obscure the debate over the merits of 
alternative survey methods. Market research initially moved to the telephone 
because it was cheaper, and the ^ssue has often been seen as a tradeoff problem. 
There has been an impression that one sacrifices quality for substantial savings. 
Social scientists, not prepared to relax quality standards, have consequently been 
less attracted to telephone-based research. Since the evidence supports the view 
that there is no overall loss in quality, however, the question is not one of tradeoffs. 
It is instead simply a direct cost comparison of two methods that for most purposes 
produce results of equivalent quality. When the costs are compared directly, the 
only conclusion is that when the telephone survey can be used it is a valuable way 
of reducing research costs at no overall loss in quality. 

Telephone interview costs at their most expensive are only about half that of 
personal interviews, and the difference in favor of telephone surveys is usually 
greater.'' However, comparative cost data on telephone versus personal interview.s 

* Data on comparative costJi may Ih» found in Jo?H»pli R. Hochstim. op. ^it : S. Strphcn Kff{t»U»8. (^linton 
F Fink, and John P. Kirncht. op. cit ,; Hilary (J, Fry and Sylvia McNair. op. cit.; and AW mi J Tuclil'arhor 
and William R. lilecka. op. cit. 
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varies considerably depending on the specifications of the surveys. Telephone inter- 
viewing costs are especially sensitive to specifications regarding: (1) any initial 
respondent screening and the within-household respondent selecion process, (2) 
number of callbacks, (3) estimates of refusal rates, (4) length of interviews (5) 
sample sizM6) costs of WA . S lines extending to the sampled jurisdictions, and (7) 
pure random-digit or added-digit dialing. 

Cost data for different surveys are difficult to compare because studies calculate 
start-up costs, overhead, and other factors differently. Completed telephone inter- 
views in one pair of the comparative surveys discussed by Hochstim cost hall that 
of completed personal interviews. Completed telephone interviews in other parallel 
surveys reported by Hochstim averaged costing less than two-thirds that of un- 
person interviewing.* Coombs and Freedman estimated savings of approximately 
60 percent when using telephone rather than personal interviewing.'" Tuchfarber 
and Klecka estimated comparative costs per household for interviews with each 
member over age 13 of 1,000 households to obtain crime victimization, attitudinal, 
and demographic information. Costs per household using personal interviews were 
projected at over three times that of telephone interview expenses." A rough 
disaggregation of the Rand Pennsylvania subcontract costs putsxompleted per- 
sonal interviews at roughly $25 each while completed telephone iifterviews were 

about $11. . . r 

This cost ratio advantage with telephone surveys enables researchers to fur- 
ther improve the quality and quantity of the data collection. For the same costs, 
at least double the number of interviews could usually be obtained using telephone 
interviewing and the precision of the sample estimates would be improved. 

Costs are also attractive in terms of callbacks. Personal interviewers try to 
contact all the selected respondents in a cluster, and then on subsequent trips those 
who had not been interviewed on the first attempt. By the second and third call- 
backs, personal interviewers must drive across town to each neighborhood to n'a( h 
only one or two respondents. The ratio of time spent traveling as opposed to 
interviewing goes up sharply, pushing up overall costs. Because the incremental 
costs of each callback are so much lower with the telephone, the researcher can 
afford to pursue lard to reach respondents at far lower costs. The optimum number 
of callbacks depends on the population being interviewed, and the available evi- 
dence suggests that four calls (the initial plus three callbacks) should be specified 
for a general population survey.'* But whether it is two, tliree, or more, the margin- 
al cost of improving quality standards with additional callbacks is more attractive 
wih telephone surveys. Cost savings also allow researcher.s to incorporate addition- 
al devices aimed at improving data quality, such as more extens^ive interviewer 
training and briefings, higher paid and more experienced interviewers, full-time 
supervisory monitoring, and more survey pretests. 

» JosM'pli U. Hofli-stim, op. cil. 

"' I^)la^;en^; (Vwmbs and Rnnald Fn-cdman, op. fit . , , 

" Alfred J. TurhrarlH-r and William K. Klecka. op. . it ; ( osl data may idso hv found m S. SL-'phrn 
K^'H,-... CluUon F. Fink, and John P. Kirschl. op. nt.: Hilary C Fry a.,d Sylv.a MrNa... op. nt 

For a Curtlu.r diHCUHsion ofcallhatks William (I. I).ink..|»H.rK ''n-l <;<•«''>:♦• « '^''i^,"?'':'"^!;";' 
H,aM and ( alllmrks in Sample HurvevH." .hurml o/' Mnrktmn Hv.nm-h. Vol. 10 May 197,5 pp lb ) IhH 
V . Braun and Freda Marmien, ••FHecliveneHH and Costs of Interviewer (\dlbaeks m ,. Nation;, 
sin vev •• a paper prepared at the Survey Ke,s*.arrh Centre, York I'n.versdy. Toronto. ( anada. .h.l> 
1H7«; and Alfred .). Tuctifarher and William H. Klecka, op nl 
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CONCLUSIONS 



Findings from the Rand Pennsylvania suivveys are consistent with other recent 
research, leading to the central conclusion oK^his report: telephone surveys can 
provide representative samples of the general population, and can obtain reliable 
answers on sensitive topics. The telephone survey does as well as the personal 
survey for most purposes, and telephone surveys haVe a greater potential for a high 
degree of quality control and flexibility at attrgctivVcosts. 

This is not to say that telephone surveys are a panacea for concerns about high 
refusal rates, social desirability bias, and other problemsVacing personal interview- 
ing. These problems are inherent to all forms of survey re^e^rch. But research has 
come a long way in establishing the general reliroility and utrUty of telephone inter- 
viewing. In terms of the basic questions of sampling, response reliability, and 
quality control, the evidence regarding telephone surveys is sufficiently positive 
that researchers should feel free to use them for most general population studies. 
Findings of this and earlier research have indicated that social scientists should be 
highly skeptical about using telephone surveys during circumstance^ when (1) the 
particular target population has low levels of telephone penetration\(2) extensive 
income data must be collected, (3) the interview exceeds 30 minutes, wid (4) intri- 
cately worded questions must be asked. Sensitivity to the limitations and advan- 
tages of telephone interviewing can enable researchers to exploit it fully as a 
valuable tool for the collection of social science data. 

VI 

Looking Forward 

In that spirit, the value of telephone surveying could be enljanced by action in 
two areas. Above all, journal editors, reyiewers, and program officials in funding 
agencies and foundations should require greater specificity about research proce- 
dures. This review was hampered because njany of the telephone studies cited in 
this report fail to outline survey procedures regarding several basic points. At S 
minimum, it seems to us, telephone-based research should include for the record: 
(1) telephone penetration or estimated penetration among the target population, (2) 
random-digit dialing or added-digit dialing techniques used, (3) within-household 
selection procedures, (4) refusals as a proportion of eligible respondents, (5) number 
of callbacks, (6) length of interviews, and (7) opening remarks. Until this informa- 
tion is reported on a regular basis, it will be difficult to develop a set of reasonable 
standards by which to judge proposed or completed research. 

Second, those conducting methodological studies can begin to target on specific 
aspects of telephone surveys rather than continuing to replicate earlier work on the 
general comparability of telephone versus alternative survey methods. Several 
areas in particular need attention, and we would urge that comparative and experi- 
mental research be conducted on the following: (1) various strategies for initiating 
interviews that both inform respondents and secure their cooperation, (2) impact 
of different within-household respondent selection techniques on refusal rates and 
on sample bias, (3) reliability and refusals associated with requesting extensive 
income data, (4)breakoff' rates and fatigue effects in telephone interviews over 20 
minutes long with general population surveys, (5) issues in transferring scales and 
complex attitudinal items into telephone questions, and (6) determinants and 



44 



effects of fast interview pacing. This is not an exhaustive agenda for future re- 
search, but it represents our view that we should now looic beyond the fundamental 
questions about sampling and reliability of telephone interviews. The telephone 
survey is a valuable research tool; the issue is how to make it even better. 



Appendix A 

THE PENNSYLVANIA SURVEYS OF MEDIA EFFECTS 



The theoretical impetus behind the data collection involved testing a theory of. 
media usage and pplitical knowledge in a variety of media en\ironmenls. Data on 
.media habits and political arwareness in different media contexts would ajso permit 
evaluation of the impact of the Federal Communications Commission's localism 
policiies, a series of regulations requiring broadcast stations to foster community 
knowledge and awareness. Analyses of these substantive issues are reported else- 
where. . • 

The concerns of the research led the survey to cohcentrate on a single major 
media market. Data had to be collected by monitoring and coding the content of| 
local print and broadcast media available to each respondent,. and that required 
concentrating on a few markets. In addition, it would help to hold constant factors 
related to stat6 and regional culture. A theory of media environments suggejjted 
that we should find a market ^that had cities that wete alike in as many ways as 
possible, but nonetheless represented the following media contexts: (1^ a large 
centraJ city with a major daily newspaper and several television stations, (2) a 
suburban city without its own daily newspaper or televisipn station, (3) a suburban 
city with a strong daily newspaper but without a television station, (4) a city in or 
adjacent to 9 major market with its own television station and daily newspaper, Snd 
(5) a free-standing city some distance from these television stations. Additional 
criteria directed the choice away from twin-city markets, state capitals, and multi- 
ple-state markets. With these goals in mind, Rand staff reviewed the distribution 
of media outlets and the demographics of cities of comparable size in all the top 
television markets. Among the top 50 markets, the Pittsburgh area appeared to 
best meet thei^ standards with the cities of Pittsburgh, Wilkinsburg, McKeesport, 
Johnstown, and Williamsport. Bethel Park was added to provide a different type 
of suburb for this methodological study. Greenshurg was added becatise it was . 
scheduled to receive a UHF television station, and created an excellent opportunity 
to collect baseline data for a future investigation. Together these seven cities pro- 
vided a series of varied media cost environments along with generally similar 
demographic characteristics (Table 17). 



THE TELEPHONE SURVEYS 

The telephone surveys consisted of 2,642 interviews conducted, under subcon- 
tract from Rand, by the Opinion Research Corporation. The universe sampled was 
the total, honinstitutional, residential telephone household populaitidn, 18 years or 
older, in seven Pennsylvania cities. A technique for random probability sampling 
telephone numbers was utilized, which gave all numbers, listed and unlisted alike, 
an equal chance of selection. At the household level, quotas were assigned based 
on sex. From the O.R.C. W\TS facility in Princeton, New Jersey, telephone inter- 
viewing began on September 7 and ended four weeks later on October 5, 1976. 
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Table 17 

Comparative Demographics for Seven Pennsylvania Cities 



City 


. 1970 
Population 


Change 
1960-1970 


% 
Black 


% 

Foreign 
Stock 


Median 
Education 


Manufacturing 


% 

Profesaional 
' St Managerial 


Median 
Family 
Income 


% 
Balow 
$5,000 


% 
Above 
$15,000 


% 
With 
Telef>hone 


Pittsburgh 


520,167 


-13.9 


20 


26 


11.5 


21 


22 


$8,787 , 


22.2 


\16.1 


91.5 


Bethel Park 


34,778 


+ 47.1 


0 


18 ' ' 


12.7 


23 


^'40 


13,218 


5.9 


3V>^ 


98.7 


Wilkin^burg 


26,759 


- 10.9 


20 


21 


12.2 


24 


26 


9,236 


'18.7 


16.9 


95.4 


McKeeaport 


36,133 


- 16.5 


10 


31 


10.6 


38 


17 


8,566 


22.9 


12.2 


, 92.2 


Johnstow^r 


42,476 


- 21,3 


6 


25 


10.7 


40 


14 


8,030 


24.1 


7.8 


H.9 


Greeiuburg 


15,870 


- 8.7 


1 


18 


12.3 


24 


NA 


9,383 


NA 


19.1 


. NA ' ...^ 


Williamsport 


37,918 


- 9.6 


3 


9 


12.1 


39 


19 


' 8,253 


21.9 


11.6 


89.6 \ 



SOURCE: U.S, Bureau of the Census, County and City Data Book: 1972 (U.S. Government Printing Office, Washington, DC, 1 973). NA « Data 
not available. 
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Selection of Households within Cities: Added-Digit Dialing 

According to the Census Bureau, almost nineteen out of every twenty 
households in the»*»nties have telephones (Table 17). Pennsylvania Bell representa- 
tives estimated that as hiany as one quarter of all working residential numbers in 
these cities may not be listed in the telephone directory. In order to reach unlisted 
householdp^a modified form of random-digit- dialing was employed. Telephone 
niimbers werevlialjen at random frpm the directories and constants added to the last 
digits to generate new numbers. Added-digit dialing can tfius access those unlisted 
numbers scattered Ihroughout the* tegular listed numbers, but avoids dialing num- 
bers in unuiBe,d exchanges.' 

Selection and Contact of Respondents within Households 

r V 

Telephoiie numbers were desilSniated in advance for male or female respon- 
dents/ 18 years oi age or 6ver.* Call sheets were initially designated half male and 
half fem^e/Ten days after the survey began, the proportion of numbers designated » 
for raple interviews was increabed substantially as it became apparent that male 
work schedules, refusal rates, and contact rates would seriously overrepresent 
women in the sample unless some action was taken. Quotas for completed male 
interviews were then assigned to each city to approximate Census estimates of each, 
city's proportion of adult males. (The problem of underrepresenting malos is of 
course a common one).^ , 

The substantive purp^ises of the research required that only those respondents 
who lived within the jurisdictional boundaries of the seven selected cities be inter 
viewed. Most of the cities were relatively easy to isolate by their telephone ex- 
changes. Wilkinsburg was more difficult to isolate because it shares seven ex> 
changfjs with eastern Pittsburgh and ac^joining cities. Only about one-fourth of the 
phones in the iseven exchanges are Walkinsburg numbers. For Wilkinsburg and the 
other cities as well, an initi^:! screening question was employed to insure that the 
rebpondiPts did, ift fact, reside within city limits of the appropriate city. 

Up to five calls were made to each telephone number in order te interview an 
eligible respondent. Business, institutional, group-quartered, and non-English 
speakipg numbers were excluded as well as those residing outside the selected 
cities and boroughs. Callbacks were made to all numbers which were unanswered. 
bu3y, or when the appropriate respondents were busy or not at home. The deposi- 
tion of all calls is indicated in Table 18. Over half the uncompleted calls were to 
ineligible respondents and to households outside the survey cities. A net refusal 
rate of 28 percent is estimated .by as3un3jijg that the refusal rate for respondents 
inside thf? city area and those outside the city limits were the same. The latter group 
were immediately screened oufc of the interview. 

* See above, pp. 1M2. • ' 

* See above, pp. K^J6. ^* 

' See, e.g.. Barbara Bryant, op. cit..; ^. 0 Eastlack, Jr. and Henry Assael, op. cit.; OeorKe C. 
'The Elusive Male: Some Mcthodojbgical Notes on Survev Research be«ij(n." Puhliv Opinion {iuarUrlw 
Vol. 38. Summer 1969, pp. 264-259. ^ , 



Table 18 

Disposition or 'All Telbphonb Calls ' 



f 






CaUedBack. 










Ineligible 










Not Home/ 








Reside 






Number 






q 


Buty 








Out of 


No Elig. 




not 




CM 


Completed 




No Atuwer 


Busy-Line Refiutd 


City 


Retp. 


Language 


Working 


BuainM 


#1 


12.1% 


12.6% 


28.4% 


0.6% 


10.2% 


14.5% 


2.8% 


0.3%- 


14.6% 


4.1% 




(1.492) 


(1,661) 


. (3,606) 


(60) 


(1.264) 


(1.806) 


j(346) 


(31) 


(1,784) 


(611) 


#2 


12.6 


14.8 


40.5 


08 


10.4 


13.8 


2.2 


0.1 


2.3 


2.4 




(629) 


(739) 


(2.026) 


(40) 


(519) 


(691) 


(112) 


(7) 


(115) 


(120) 


#3 


10.6 


14.7 . 


47.3 


0.7 




10.8 


2.8 


0.1 


0.7 


.3.6 




(291) 


(402) 


(1.294) 


(20) 


'*^9) 


(295) .. 


(76) 


(3) 


(18) 


(97) 


#4 


9.3 


12.1 


-64.6 


0.4 


9.0 


9.6 


1.7 


0.1 


0.7 


2.4 




(160) 


(195) 


(880) 


(7) 


(145) 


(155) 


(28) 


(1) 


(11) 


(39) 


#6 


8.2 


11.4 


61.4 


0.0 


7.0 


7.2 


2.5 


9.1 


0.7 


1.6 




(80) 


(111) 


(599) 


■ '.(0) 


(68) 


(70) 


(24) 


(1) 


(7) 


(16) 
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PERSONAL INTERVIEWS 

\\ , " < 

During the same period, personal interviews were also conducted in Bethel 

Park and Wilkinsburg. Within-household respondent selection procedures, number 

of callbacks, and the survey instrument itself were the same for both personal and 

telephone interviews. Two hundred face-to-face interviews were completed in each 

of the two suburban cities. 

Besides the setting of the interview— the respondent's home versus over the 
telephone— only one other major difference was involved. As vith virtually all 
personal interviewing, the study used cluster sampling the field in Wilkihsburg and 
Bethel Park. Addresses chosen at random fVom telephone directories provided 
twenty-five sampling points in each city. Starting with the next house to the right 
of that starting point, every other residence was listed as a selected household. 
Eight interviews were then completed in each cluster. In a step that goes beyond 
most personal surveys, the eight interviews in each cluster were collected by two 
different interviewers to reduce the compounding of potential interviewer bias 
with neighborhood effects. The refusal rate in. Wilkinsburg was 18 percent, and 24 
percent in Bethel Park. ^ ^ ' 

There is one further use of the Rand Pennsylvania surveys which should be 
noted. The seven city samples may be viewed as a sample of urbanized western 
Pennsylvania stratified by city size. Weighting Pittsburgh respondents in the sam- 
ple by a factor of 2 properly ))alances the proportions of major centra] city residents, 
small central city residents, urban fringe resi()ents, and other urban place residents 
in the Pittsburgh and Johnstown urbanized SMSAs. The weighted merged sample 
closely approximates western urban Pennsylvania characteristics in terms of 
income, sex, and occupation. 




' \ 

\ 



\ 



/ Appendix B 

MASTER QUESTIONNAIRE FOR THE SEVEN 
PENNSYLVANIA TELEPHONE SURVEYS 



The questionnaire which , follows is a composite of the instruments used for 
telephone surveys of all seven cities in the Rand Pennsylvania project A few 
questions were asked in certain cities which were omitted in others, as m^icated 
by notes in a separate typeface. As an illustration, this questionnaire gives Greens- 
burg as the city name where the other cities would have been inserted m alterna- 
tive versions. Greensburg cable and regular TV stations are used in question 8. 
Questions not asked of Greensburg respondents are also included, so that the 
composite iricludes all questions that appear on the forms used in other cities. 

The Bethel Park and Wilkinsburg personal interview questionnaires were iden- 
tical to the respective Bethel Park and Wilkinsburg telephone questionnaires ex- 
cept that the word "calling" was omitted from the first sentence of the introduction, 
and interviewers recorded cluster numbers, sequence, and location at the top of the 
questionnaire form on page 51. ^ 
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51407 
090776 



THIS ISA MASTER COPY THAT INCLUDES 
ALL QUESTIONS FROM ALL FORMS USED IN 
THE TELEPHONE INTERVIEWS!: 



TELEPHONE NO. : ( )1 

A. CUDE 



PHONE CALL RECORD FORM NO. : _ 
DATE: 1976 



(punch) 



6REENSBIIR6 

JOHNSTOWN 
McKEESPORT 
PITTSBURGH 
WiLLlAMSPORT 
BETHEL PARK 
WiLKINSBURG 
DIFFERENCES IN THE FORMS (OTHER 
THAN THE CHANGE OF CITY*) ARE 
NOTED IN THIS TYPEFACE. 



OP 



TIME STARTED: 



TINE ENDED: 



AM 



.punch) 
PM 



(Punch hour only) 
' AM 



PM 



LENGTH OF IhTTERVIEW:. 



(pimch) 

imiRVIEW COMPLETED ON CALL (CIRCLE) : 
#1 n #3 #4 #5' 



NaNums 



#2 #3 #4 
(punch) 



INTERVIEWER: 



CODE# 



1 MALE 
2 FEMALE 



(punch) 



SEX (CIRCLE): 

2 FEMALE 

Hello, ny name is - and I'm calling from Opinion Research Corp- , 

oration in Princeton, New jersey. We arejibing a survey in a number of communities 
in Pennsylvania about local and nationa^isues . Your phone number was picked 
at random and I'd like to get your opinwns. . 

First of all, do you live within 
the city limits (boundaries) of: 
Greensburg? " 



1 YES— ►GO TO Q. 1 

■2~R0 

9 DON'T KNOtV 



TERMINATE 



In general, how interested would 
you say you are in current affairs 
in the city of Greensburg? Would 
you say you are very interested, 
interested, slightly interested, or 
, not interested at all? 



1 VERY INTERESTED 
2 INTERESTED 
• 3 ■ SLIGHTLY INTERESTED 
4 NOT INTERESTED AT ALL 
9 DON'T KNOW; NO RESPONSE 



2. From what source would you ^ay you get most of your information about 

current affairs in the city of Greensburg ? I'rom ts Iking with people, from 
newspapers, television, radio, or magazines? (INTERVILm: IF MORE 1\m 
ONE SOURCE IS MENTIONED, ASK -- "Can you tell me which one of those i. 
your single most important source of news about Greensburg?") 



01 TALKING Wim PEOPLE 
02 NEWSPAPERS 
03 TELEVISION 
04 RADIO 
05 MAGAZINES 



06 OTHER SOURCE 
07 MUITIPLE SOURCnS INCLUDING TCLBaSTON 
(REFUSES TO CHOOSE ONE MAIN SOIIUCI!)' 
08 MJLTIPIJi SOURCES EXCLUDING TELEV ISION 
(REFUSES TO OmSR ONE MAIN SOlJRCli)' 
09 NONE; PAYS NO AmMION TO 
IXXIAL Al-FAIRS 
99 DON'T KNOW; NO RESPONSE 



l> 
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(1.2A ASKED ONLY IN GREENSBURG-2 . McKEESPORT-i.. BETHEL PARK-8, AND WlCKINSBURG-9 
2A How would you comwre your interest in Greensburg news with your 

interest in Pittsburgh news? Would you s«y your interest m Greensburg 
.news is more, shout the same , or less than your interest in Pittsburgh 
news? 

1 MORE lOTtREST IN GREENSBURG NEWS THAN IN PITTSBURGH NEWS 
' ABOUT THE SAMB INTEREST IN GREENSBURG NEWS AND PITTSBURC3H NEWS 
"3 LESS INTEREST IN GREENSBURG NEWS THAN PITTSBURGH NEWS 
9 DON'T KNOW;, NO REf 



3. One of the things we hope to learn is how people get information about ; 
currant events. Let's start with television ... 

/ ♦ 
Do you have a television in yoar^ — - x 

home? — • 2 N0_ J— ►SKIP TO Q. 9 




fIF "YES" ON Q. 3. ASK) ; 
4. Do vou' have cable television? 



1 YES 
2 NO 

9 DON'T KNOW; NO RESPONSE 



S. National television news includes CBS News with Cronkite, NBC News with 
Chancellor, and ABC News with Reasoner. They're shown in the early 
evening aiwid six^thirty or seven, five days a week Monday through Fri- 
day. In a typical week, how many evenings do you get a chance to watcK* 
Cronkite, Chancellor, or Reasoner if any at all? (INIERVIEWER: IF 
R. IS UNCERTAIN, SAY - "Just give us a general idea of the nuiiber of 
times." IF R. SAYS TWO NUMBERS e.g., "3 or 4 tiines a week" -- CIRCLE 
THE LOWER OF THE TWO. IF R. SEES NEWS LESS THAN CNCE A WEEK, PROBE TO 
FIND our WHETHER R» OCCASIONAUY OR NEVER WATCHES "Then, if you watch 
less than once a week, would you say you only occasionally watch or . never 
watch?") . 

1 ONE EVENING A WEEK 
2 TWO 
3 THREE 
4 FOUR 

5 FIVE; EVERY DAY OF THE WEEK , , 
6 lESS THAN ONCE A WEEK; OCCASIONALI.Y 
7 NEVER 
9 DON'T KNOW; NO RESPONSE 
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■ (Greensburg) 

^OOmNUATION OF EXCLOSION SEQUENCE FOR IWOSE ANSWERING "YES" O N Q. 3) 
— Local W stations have their own local and regional news al/.ig with the 
weather and spdrts. TJiis local news Is broadcast in the early ^eniiig 
Around 6 o'clock and again in the late evening at 11 o'clock, seven days 
« week. In a typical week, how many evenings do you get a chance to 
watch a broadcast of the local news - if any at all? (INTERVIEWER: 
INSTRUCTIONS FOR Q. S ALSlTSPPLY HERE.) 



ERIC 




EVERY DAY OF THE WEEK 




KUl (KB EVENING A WEEK 
V02 T/n 
k03 THREE 
V04 FOUR 



(IF RESPONSE 1-8 ON Q. 6. ASIQ; 
7. DO you usually watch the local 
news around 6 p.m. or the local 
news at 11 p.m. or do you 
usually watch both broadcasts? 



SKIP TO Q. 



1 ONLY mOi AROUND 6 P.M. 
2 "MOCTLY" WATCH AROMD 6 P.M. 
3 GNLY KATOl AT 11 P.M. 
4 "MOSTLY" WATCH AT 11 P.M. 
5 USUALLY NATCH BOTH 
9 DGN'T KNOW; NO RESPONSE 



8. Which station or sutions xlo you watch most often for the local , 
news? (XNTER/IEWBl: DO NOT PROBE PGR ADDITIONAL MOrTIONS, BOT CXE 
UP TO TWO. IF TWREE OR MORE, ONLY CIRCLE 88 IN "FIRST MHfTION" COLUMN. 
WE MUST AVOID CONFUSING CABLE CTOHNEL NUMBBtS WITH ASSIGNED STATION 
CHANNELS. HERE, IF ANY \WSBL IN IHE CABLE CHANNEL COUMN IS MENTIONED, 
CHECK TO CONFIRM ITS ASSIGNED CHANNEL. FOR EXAMPLE, IF R. MENTIONS 
CHANNEL 7, SAY— "1$ that cable channel 7, WTAJ out of Altoona and Johns- 
town, or is it channel 7, WlW"out of <<necling?" — THEN CIRCLE THE 
ASSIGNED CHANNEL lOffiER.) 



ASSIGNED 



FIRST 


SECOND 




CABLE 




mmati 


MomoN 




CHANNELS 




02 KDKA 


02 


XDKA 


Pittsburgh 




(CBS) 


04 WCAE 


04 


WIAE 


Pittsburgh 


3 


(ABC) 


06 WJAC 


06 


WJAG 


Jobnstown 




(NBC) 


10 WTAJ 


10 


WCAJ 


Altoona-Johnstown 


7 . 


(CBS) 


11 WIIC 


11 


WIIC 


Pittsburgh 


12 


(NBC) 


?8 WOPC 


38 


WDPC 


Altoona 




(ABC) 


07 KIRF 


07 


WTRF 


Wheeling, WV 




(ABC/NBC) 


08 WGAL 


08 


WGAL 


Lancaster 




(NBC) 


09 WSTV ' 


09 


WSTV 


Steubenville, CH 




(ABC/CBS) 


IS WLYH 


15 


WLYH 


Lancaster 




(CBS) 


19 WJNL 


19 


WJNL 


• 

Johnstown 




(CBS) 


S3 WPGH 


S3 


WPGH 


Pittsburgh 


10 




77 OTHER 


77 


OTHER STATION(S) MENTIONED NOT LISTED ABOVE 



88 WATCHES VARIOUS STATIONS; SWITCHES AROUND 

98 NO SECOND MENTION 
99 DON'T KNOW; NO RESPONSE 
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"4 

How often do you usually hear the news 
on the radio? Several times a day, 
once a day, two or three times a week, 
once a week or less, or never? 



Let's talk now about newspapers. 

In a typical seven day week, how many 
days would you say you usually get a 
chance to read a newspaper if an/ ^ 
at all? (INTERVIEWER: IF R. SAYS TWO 
NUMBERS e.g. "3 or 4 tines a week" 
CIROE THE LOWER OF "WE BO. IF R. 
READS PAPER LESS IHAN ONCE A WEEK, 
PROBE " "Would you say you occasionally 
or never read the paper?') 



L SEVF.RAL TIMES A DAY 
2 ONCE A DAY 
3 T\^ OR imE TIMES A WEEK 
4 ONCE A WEEK OR LESS 
5 NEVER 

9 DON'T KNOW; NO RESPONSE 



, 01 READ PAPER ONCE A .WEEK 
, 02 im TIMES 
, 03 THREE TIMES 
04 FOUR TINES 
35 FIVE TIMES 
06 SIX TIMES 
07 SEVEN TIMES EVERY DAY 
08 \£SS THAN ONCE A WEEK; 
fYTJLqTnNALLY 



09 NEVER 
99 DON'T KNOW 
NO RESPONSE 



; 1>SKIP TO 

eJ ,Q. 12 



fIF RESPONSE 1- 8 ON 0. 10. ASK): - .Ti^nrnvTPWFR. 

11. Which newspaper or newspapers do you read? (INTERVIEWER. 
FIRST TOREE RESPONSES.) 



CODE ONLY THE 



FIRST 

^e^^0N 


SECOND 
MENTION 


THIRD 
MENTION 


01 


01 


01 - 1 


02 


02 


02 -- 


03 


03 


03 -- 


04 


04 


04 


OS 


OS 


05 -- 


06 


06 ' 


06 -- 


07 


07 


07 -- 


08 


08 


08 -- 


09 


09 


09 


10 


10 


10 -- 


11 


11 


11 -- 


12 


12 


12 -- 


13 


13 


13 


14 


14 


14 ••- 


IS 


IS 


15 -- 


16 


16 


16 -- 


17 


17 , 


17 -- 


18 


18 
98 


18 -- 



JOHNSTOWN TRIBUNE- DEMOCRAT 



(Specityj 



NEW PITTSBURCW COURIER (weekly) 



Of 

OflHER WEEKLY PM^K: _ ' „- , Wxf 

(Specify - e.g. "(Jreen tlheeV) 

CHRISTIAN SCm^lCE MONITOR 



NEW YORK TIMES 



OTHER NATIONAL PAPER: 



(Specify) 



97 



99 



NO SECOND MENTION 
■ NO THIRD MENTION 
-DON'T KNOW; NO RESPONSE 



6u 
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Q.11A ALSO A5KED IN BETHEL PARK-8 ABOUT THE DORO MRWS 



--5 



IF "11 - WILKINSBURG GAZCTTi;" IS CIRCLLD QN Q.ll, ASK: 



Ilk. UTien you look at the front paj^e of the* 
' Wilkinsburg Gazette , do ypu usually read 
most of the stories about Wilkinsburg, 
only an occasional story about Kilkins- 
burg, or don't you pa) much attention 
to the news stories? ' ' 



1 miAD hDST OF HE STORIES 
2 RHAD ONLY AN OCCASIONAL STORY 
3/DON'T PAY MUai ATTENTION TO 
»■ iim NI^VS STORIES 
^. 9 DON'T KNaV; NO RESPON^ 



GR£^I 



12. 



[lU. IS NOT ASKED IN 



SBURG. CONTINUE WITO Q. 12.] 



The next few questions are to help us determine how well public officials 
have succe^ed in getting known in your coimunity. 

First » could you give me the name of 
the Mayor of Greensburg? 



13. Now 9 could you give me the name of 
any one of the menibers o| the 
Greensburg City Council? 



14. Next» the City of Greensburg / 
police chief? ^ 



15. The Superintendent of the Greensburg 
Public Schools? 



1 MAYOR (ROBERT A.) BELL ' 
2 ANY OTHER NAME GIVEN 
9 NO; DON'T KNOW; NO RESPONSE 

1 (JOHN V.j FELICE 
(GEORGE S.) RUCM 
(RONALD E.) SILVIS • f 
(EDWARD M.) ZIFF 
2 ANY OTHER NAME GIVEN 
9 NO; DOK'T KNOW; NO RESPONSE 



1 CHIEF (NICK J.) FICCO, JR. 
2 ANY OTHER NAME GIVEN 
9 NO; D(^'T KNOW; NO RESPONSE 

1 SUPT. (ROBERT) DOVEY 
2 ANY OTHER NAME GIVEN 
9 NO; DON'T KNOW; >J0 RESPONSE 



ISA. Would you happen to know the > 
name of the Mayor of Pittsburgh? 

ISB. Now, the Pittsburgh police chief? 



i MAYOR (PETER) FLAHERTY 
2 ANY OTHER NAME GIVEN 
9 NO-^ DON'T KNOW; NO RESPONSE 

1 SUPT. (ROBERT) COLL 
2 ANY OTHER NAME GIVEN 
9 NO; DON'T KNOW; NO RESPONSE 



16. ,What about the name of the Governor 
of. the State of Pennsylvania? 



17. Now, the name of Pennsylvania's 
Lieutenant Governor? 



18. In the Federal government, could 
you tell me who is now O iief Justice 
of the U.S. Supreme Court? 



1 GOVERNOR (MILTON) SHAPP 
2 ANY OTHER NAME GIVEN 
9 NO; DON'T KNOW; -NO RESPONSE 

1 LT. GOVERNOR (ERNES'O KLINE 
2 ANY OTHER NAME GIVEN 
. 9 NO;^^'T KNOW; NO RESPONSE 

1' CHIEF JUSTICE (WARREN) BURGER 
2 ANY OTHER NAME GIVEN 
9 UO; DON'T KNOW; NO RESPONSE 



ERIC 
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19. The name of the current U.S. 
' Secretary of State? 

20. And now, could you give me the 
name of the Con p-essman who 
represents this district in the 
U.S House of Representatives in 

. Washington? 



1 SECRETARY (HENRY) KISSINGER 
2 ANY OIHER NAME GIVEN 
9 NO; DON'T KNOW; NO RESPONSE 

1 REP. (JOHN H.) DENT 
2 REP. (JOSEPH) GAYDOS 
3 REP. (H.JCHN) HEINZ III 
4 REP. (WILLIAM S.) NDDRHEAD 
S REP. (JOHN P.) MJRm 
6 REP. T.) SCHNEEBELI 

7 ANY OTHER NAMES MBfTIONED 
9 DON'T KNOW; NO RESPONSE 



With the following few questions, we hope to find out how often people talk about 
different subjects. 



Every 
Day 



Once or Less Than 

TVice Once DON'T KNOW; 

a Week a Week Never NO RESPONSE 



21. For exmple, how often 
would you say you talk with 1 
family, neighbors, co- 
workers, and friends about 
sports? Would you say. . . 
XrBQTCATCGORIES. 1-4) 

22. Now, how often xould you 
say you talk with family, 
nei^ibors, co-workers, 
and friends about 
Greensburg conramity 
affairs and politics? 
(READ CATEGORIES 1-4) 

23. How about conmunity affairs 
and politics in the City 
of Pittsburgh? (REPEAT 
CATEGORIES 1-4 IF NECESSARY) 

24. Now, how bften would you 
say you talk about area 
weather? (REPEAT CSTObRIES 
1-4 IF NECESSARY) 

25. Next, how often do you 
talk about the State of 
Penn sylvania's affairs 
and politics? (REPEAT 
CATEGORIES 1-.4 IF 
NECESSARY) 

26. Now, about national 
affairs and politics? 
(REPEAT CATEGORIES 1-4 
IF NECESSARY) 



Q.23 NOT ASKED IN PITTSBURi*.H-5 
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27. Now, About organizations ^nd clubs you may belong to, like a comnunity 

service :group, a church group, a union, a lodge, and similar organizations. 
Are you, yourself, now an active member; that is, do you regularly attend 
the meetings and ,take part in the activities of any such organizations and 
clubs? , 




KNOW: NO RESPONSE 




(IF "YES" ON Q. 27. ASK) ; ■ ^ 
28. In how many such groups and 
organizations are you sti 
active member? 



29. 



1 ONE 
2 TM) 
3 THREE 
"4 FOUR 
5 FIVE 



SKIP TO Q. 31 



6 SIX 
7 SEVEN 
g- EIGHT; OR MORE 
9 DON'T KNOW; 
NO, RESPONSE 



.1 O™ DISCUSSED' 
2 SCMBTIMES 
3 RARELY 



Overall, how often is there 
discussion of public affairs and 
politics at of the meetings 
of the (these) organization(s) 
you belong to? Would you say public 
affairs and politics are discussed 
often , sometimes , rarely , or never? 

(IF "OFTEN." "SOMETIMES." OR "RARELY" ON 0. 29, ASK) ; 
30. What is usually the subject of 1 THE NATION 



7 NEVER 
9 DON'T KNOW; NO RPSPONSF. 



SKIP TO 
Q. 31 



these discussions -- the nation, 
the State of Pennsylvania, Greens - 
burg or some other place such 
as Pittsburgh? (IhTIERVIEWER: 
MULTIPLE RESPONSE PERMITIH),) 



(WORLD, TOO) 
2 PENNSyLVA^JU 
3 GREENSBURG (LOCAL SCHOOLS 

AND OOUWTY, TOO) 
4 PITTSBUROi 
5- OTHER PLACE(S) 
9 DON'T KNOW; NO RESPONSE 



31. Generally speaking, do you usually think 
of yourself as a Republican, Democrat, 
Independent, or what? 



(IF "REPUBLICAN" OR "DEMOCRAr' ON Q. 31. ASK) ; 
32. Would you call yourself a strong 1 
(Republican) (Democrat) or not a 
very strong (Republicaxi) (Democrat) ? 



a REPUBLICAN 

mm 

3 INDEPENrehfT — I 
9 DON'T KNOW; 



►GO TO Q. 33 



•SKIP TO 
Q. 34 



(IF "INDEPENDENT"^ ON Q. 37.. ASK) : 
33. Do you think of yoi'.rself as 
closer to the Republican or 
Democratic i-^rty? 



STRONG (REPUBLICAN) (DEMOCRAT) 
2 NOT VERY STRONG (REPUBLICAN) 
(DENtmT) I 
9 DON'T K>' W; NO RESPONSE 



1 CLOSER TO REPUBLICAN PARTV 
2 CLOSER TO DEMOCRATIC PARTY 
3 NEITHER • 
9 DON'T KNOW; NO RESPONSE 
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Now I '» going to read a few statements about how some people feel about keeping 
NOW 1 » f""* li^g YOU to 'tell us if you strongly agree, somewhat agree, 

^o^*a ttsa^ee. - f mn^HiSgree with ea^h statement. ^ first statement 
is^-. . . , ' 

•4'- 

Stronely Somewhat DON'T Somewhat Strongly RF.FUSE 
Xgrej • Agree KNOW Disagree Disagree TO SAY 

:^4. My friends pay a lot of ^ 
. attention to the news. 
Do you strongly ?gree, 
scinewhat agree,' some- 
what disagree, or ^ j ? 4 " 5 9 
strongly disagree? 1 ^ . *♦ 

33. It is more trouble than 
it's worth to stay well- 
infonned about current 
events all the time. 

(REPEAT CATEGORIES JF r a 5 ' 9 

NECESSARY) I 2 i ^ 

36. It bothers me when people 
talk about something in 
the news that I haven't 

heard or read anything ► 

abo'tt. (REPLAT CATEGORIES , t a «; 9 

IF NECESSARY) 1 2 ^ . ^ 

37. Sometimes politics and 
government seems so com- 
plipated that a person 
like me can't really 
understand what's going 

on. (REPEAT CATEGORIES o t a ^9 

IF NECESSARY) 1 2 5 * d . ^ 

38. I feel guilty when 1 
get too busy to read 
the paper or watch 
the television news. 

(REPEAT CATEGORIES IF o t 4 9 

NECESSARY) 1 2 3 

From what source would you say you get most of your infom)6tion about national 
a^?^irf Ld Doliticsi From talking witK~pibple, from newspapers, television, 
?Sii of^gaz ief?* (i5?SrV?EWER? IF Wm'Um ONE SOURCE IS.MFJiTiaVED, 

- ^^aT^ou ?ell .ne which one of those is your gin^le most important 
source of news about the nation?y 



01 TALKING Wim PEOPLE 
02 NEWSPAPERS 
' 03 TELEVISION 
RADIO 
. 05 MACAZINES 



06* OTHER SOURCE 
07 MUlJIPLE SOURCES INCLUDING ITiLE VfelON 
(REFUSES TO CHOOSE Of^ NlAIN SaikCEJ 

08 MULTIPLE SOURCES E^CCLUDING TCLEyiSION 
(REFUSES to QiOOSE ONE WTU SaiRCE) 

• 09 NONE; PAYS NO ATTTLTrTON TO. 
NATIONAL AFFAIRS 
99 DON'T KNOW; NO RESPONSE 



6-, 



t 



Which one of these kinds of public affairs 
do you follow most closely -- national, 
state, or localaTfairs? (INTERVIEWER: 
IF NDRE "mAN ONE KIND IS NOfTIONED, ASK -- 
"Can you tell me which one kind you 
follow most closely?" VTk. STILL FAILS 
TO PROVIDE A SINGLE RESPONSE, CIRCLE THE 
APPLICABUE MULTIPLE RESPONSE CATEGORY.) 



(IF RESPONSE 1-3 ON Q. 40, ASK) : 
■^r; Which do you follow least closely -- 
or "~T " (INTER- 

viEWER: Name twj kinds that remain. 

IF R. FAILS TO GIVE A SINGLE RESPONSE, 
PROBE -- "Is there no difference?" -- 
BEFORE CIRCLING TOE APPROPRIATE DUAL 
RESPONSE CATEGORY.)- ^ 

In the last election for President in 
1972 -- Richard Nixon ran against George 
McGovem. Did you vote in the 1972 
Presidential election or didn't you 
get a chance to vote? 



J~nStional 

,2 STATE 
3 LOCAL, , 

4 NATlflNAL AND STATE' 



5 NATIONAL AND LOCAL 
6 STATE AND LOCAL 
7 ALL THREE EQUALLY 
8 NONE; PAYS NO ATTEN- 
TION TO POLITICS 
9 DON'T KNOW; NO 

RF.SPn,N]SF. 



SKIP 
TO 

Q. 42 



1 NATIONAL 
2 SrATE 
3 LOCAL 

4 NATIONAL AND STATE 
5 NATIONAL A\D LOCAL 
6 STATE AND LOCAL 
9 DON'T KNOW; NO RESPONSE 



1 YE5> vcmjjnm. 

2 NO, DID NOT VOTH 



9 DON'T KNOW: NO RESPONSE 



^SKIP TO 
Q. 43 



(IF 'TEi " ok Q. .42. Ask} 
4ZA. Did you vote for R 



i'chard Nixon 



you 

or George McGovem? _ • 
Q.^2A ASKED ONLY IN BETHEL PARK-8 
AND WILKlNSBURa-9 

The last local election in Bethel Park was 
last year in Novetnber. Did you vote in 
the 1975 local elections or didn't you 
get a chance to vote? 

Now how about the election this November? 
Are you now registered to vote? (IF NO, 
CONTINUE...) Do you intend to register 
to vote or will you probably not get a 
chance to ? 



(IF RESPONSE 'TES, REGISTERED OR INTEND TO" ON Q. 44 > ASK) : 



1 RICHARD NIXON 
2 GEORGE MCGOVERN', 
3 OIHER CANDIDATE 
4 DON'T REMEMBER 
9 REFUSE TO SAY 

1 YES, VOTED IN 1975 
2 NO, DID NOT VOTE 
9 DON'T KNOW; NO RESPONSE 



YES, REGISTCRED TO V0« 

GISTER 




DON'T KNOW: 



WJCE TO REGISTESJ 

KO RESPONSE 



"4?! who do you think you will vote for 
in tlie election for President -- 
Ford or Carter or haven't you 
decided? 



(IF "UNDECIDED" ON Q. 45, ASK): 



FORD; WlLL VQIt KiiFUBLlCAN 
2 CARTER; WILL VOIE DEMOCRATIC 
y, (TTHER CANninATF. 



T5T If the ejection were held 
today, who do you think you 
would be more likely to vote 
for Ford or Carter? 



6- 



5 WILL NOT VOTE ' 
t> REFUSE TO SAY 



1 FORD; WILL VOTE liEPUBLICAN 
2 CARTER; WILL VOTE DEMOCRATIC 
3 OIHfiR CANDIDATE 
4 STILL SAY UNDECIDED; NO 
PREFERENCE 
5 mLL NOT VOTE 
9 REFUSE TO SAY 
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47. So far, in die Presidential campaign 

this year, would you sajj you have talked 
with people about tht' candidates ■- Ford 
or Carter -- often , sometimes , or not 



1 OFTEN 
2 SOMRTIMES 
3 hJar AT ALL 
9 DON'T KNOW; NO RESPONSE' 



at all; 



Now to finish up, I have just a few background questioius for statistical purposes. 
48. 



How many years have you lived in 
Pittsburgh? (immiEWER: IF R. 
SAYS "ALL Mi LIFE," ASK, "How 
many years is that?" AND THEN 
DfTER IHAT SAME NUMBER IN THE' 
RESPONSE SPACE FOR Q. 49 AND 
COWriNUE WITHtQ. 50.) , 

49, What is your age? (INTERVIEWER: IF 
■ R. SAYS "DON'T KNOW," ASK, "What's 

your best guess?" WRITE IN 98 FOR 
. ANYONE WHO. IS 98 OR OLDER.) 

50. Do you own your home, are you now 
buying, or dojou rent where you 
are now living? 



YEARS 

59~K)N'T KNOW; NO, RESPONSE 



YEARS. 

'99 REFUSED TO SAY; DON'T KNOW 



1 OWN HOME 
2 ' NOW BUYING HOME 
3 RENT 
9 DON'T KNOW; NO RESPONSE 



[sbA.. IS NOT ASKED IN PHONE INTE.RVTEW. CONTINUE WITH Q. 5UB.] 



4 



Q.50B ASKED ONLY 1^" PITTSBURGH-5 
SOB. Do you happeh to live in or just a. 
few blocks from the neighborhood of 
West End, Esplen, Corliss, {. .eraden, 
Elliott, Banksville), or Brighton 
Heights? (im^VTEWER: IF R. ASKS, 
"A FT^W BLOCKS" WJ^S NO MDRE-ITHAN 
ABOrr FOUR OR FIVE. BIj0CKS0__ 

4^" — — "" " 
Do you live in or just a few blocks 

from. the neighborhoods of Hays, 

' Gienwood, Hazelwood, Greenfield, 

. St. Clair, or Carrick? 



fINTERVIEWF.R: IF "NO" TO "BOrm ABOVE, 
CIRCLE "3 ( IHER PITTSBURGlFTND CCN- 
TINUE ON TO Q. 51. IF R. HAS SAID 
"DON'T KNOW" TO ON E OR BOTH ABOVE, 
THEN CIRCLE "9 IXTN'T KNOiV" "AND 
CONTINUE WITH Q. 51.) 



1 YES (W'ST PITTf )■ 

^55 

Don't Know 



■CO TO Q. 51 



2 YES (SH PITTS ) — ► CO TO Q. SI 
Don't Know 




3 aniFJ^ pnTSHURcii 

9 DON'T KNOW; NO RESPONSF, 
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SI. 



Do ajny of the adults in your household 
work outside of the City of Greensburg 
say in Pittsburgh, Altoona, or other, 
places? » 



v 



(IF RESPONSE 1-4 ON Q. SI, ASIO: 

I noi 



1 YES, ONE OR MORE IN PITTSBURm 

2 yes, one or m)re in pittsburgh 

and other place (s) 
3 ye57 in other places but not 
pitfsburCh 

A NO, ALI, WDBK IN GREENSBURG 



S NOCNE ' INF 

NOWWDRKING 
'9 nrw'T Kunw; wn w.mKP. 



SKIP 
Q. S4 



52., What is the head of the Household's usual occupation? 
(ilTMVliiWkk: WRITE III OCCUP\TI0N3 




(ORC WILL 
CODE) 



S3. (bnER\aENER: IF OCCUPATION IS 
OBVI0B8LY NOT GOVERMCNTAL DO NOT 
ASK. --) ts that a -job with the 
local, state, or federal government? 



L YES, LOCAL GOVERIV^ JOB 
2 YES, STATE JOB .i 
3 - YES, FEDERAL CIVII ' a JOB 
4 YES, FEDERAL MILITARY JOB . 
S NO, NOT GOVERIMENr JOB, 
9 DON'T KNOW; NO RESPONSE 



54. 



What is the last grade or year 
that you conpleted in school? 



55. 



lu addition to being an American, 
>^t do /ou think of as your 
main ethiiic or nationality group, 
suEfTas Italian, Geman, Black, 
or >^t? 



1 NO SCHdOLING 
2 ELBENTARir SOCOL - SIH GRAI£ OR LESS 
3 HIGH S(HX)L INOCMPITIE (9TH, lOTH, IITH) 
4 HIGH SOCOL GRADUATE j 
5 ADVANCED VOCATIONAL OR TEOINICAL 

SCHOOL 
6 Sam COLLEGE ' - 
'7 ^COLLEGE GRADUATE 
8 BEYOND COLLEGE 
9 REFUSE TO SAY 

01 BLACK (AFRO-AMERICAN) 
02 ENGLiai (5 SCOTCH-IRISH) ^ ' 

03 IRISH 

04 OnHER NORTHERN EUROPEAN OR MIXIURE 
(Bng. , French, Irish, German; Scan. ) 
ITALIAN 

FJkSTERN EUROPEAN OR MIXTURE 
(Polish, Czech, Hiaigarian, Russian, 
Yugoslavian, Romanian, GreeX) 
ORmm; PACIFIC ISLANDER 
(Chinese, Japanese, etc.) 
08 LATIN (Spanish, Portugese, Mexican, 

Puerto Rican, South American) 
09 OTHER (Specify): 



05 
06 



07 



10 MN'T KNOW; UNDIFFERENTIA.TED; 

. CAN'T SAY 
99 REFUSE TO SAY 



•12 
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56. What is your current marital 
status? Are you married, 
widowed, separated, divorced, 
or were you never married? 



57. How many children 17 years old 
or youTtger are living in your 
household? 



58. Including yourself, hpw many 
adults 18 yeaii or over live 
in your household? 



L MARRIED 
2 WIDOWED 
'3 SEPARATED 
4 DIVORCED 
5 NEVER MARRIED 
9 NO RESPONSE 




1 ONE 
2 TW 
3 IHREE 
4 FOUR 
5 FIVE 



6 SIX 

■ 7 SEVEN OR MOPE 
8 NONE 

9 DON^T KNOW; NO RESPONSE 




1 ONE — ►GO TO Q. 60 

3 THREE 
4 POUR 
5 FIVE 
'6 SIX 
7 SEVEN , 
8 EIOfT OR MORE 
Q pf]^'7 WJTMt NO RESPONSE 
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59. Which of these describes 
you in your household? 
(INTERVIEWER: FOR A 
FEMALE RESPONDEhTT, ONLY 
READ CAIEOORIES 1, 3, 5', 
y AND 8. FOR A MAUE, ONLY 
READ 2, 4, 6, 7, AND 8.) 



1 Wif^ or feniale head of house^lpld 
2 Husband or male head of hov^ehqld 
3 Daughter of head of househol4 
4 Son of head of household/ 
5 Mother (or in-law) of head of household 
.. 6 Father (of i^i-law) o 
7 Some other family 
8 No lamily irelati 
9 REFUSED TO SAY 



head of household 
ilationship, or 
ihip 



1 Group A - Under $1)6.000 , . „ 

2 Group B - Betweeri $1.0,000 and $1^,000 
3 Groi^) C - Betwefen $15,000- and $20,000, 
4 Group D - Ovejt $20,000 ' 
5 DON'T KNOW 
9 REFUSE TO/SaY 



We have four large categories of 
annual family income. A, B, C, and 
D. We would like you to estimate 
which of the following categories 
you and your ijiinediate family would 
be in btffore taxes in 1975. .. 
(READ CATEGORIES 1-4) 

That concludes our interview. Thank you very much. 

(»»»»*»»»»»*»*»»»»»»»»*»********D0 NOT ASK**************V************************ 

INTERVIEWER: PLEASE ESTIMATE THE 1 NO DIFFICULTY. 

RESPONDENT'S UNDERSTANDING OF 2 JUST A LITTLE DIFFICULTY 

THE INTERVIEW. 3 A FAIR AMOUNT OF DIFFICULTY^ 

4 EmEME DIFFICULTY 



\ 



A 



7x 



/ 
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